Apr 13 21:40:52 user nova-compute[71325]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 13 21:40:55 user nova-compute[71325]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71325) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71325) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71325) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 21:40:55 user nova-compute[71325]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:40:55 user nova-compute[71325]: INFO nova.virt.driver [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 13 21:40:55 user nova-compute[71325]: INFO nova.compute.provider_config [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] Acquiring lock "singleton_lock" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] Acquired lock "singleton_lock" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] Releasing lock "singleton_lock" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] Full set of CONF: {{(pid=71325) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ******************************************************************************** {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] Configuration options gathered from: {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ================================================================================ {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] allow_resize_to_same_host      = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] arq_binding_timeout            = 300 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] backdoor_port                  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] backdoor_socket                = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] block_device_allocate_retries  = 300 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] block_device_allocate_retries_interval = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cert                           = self.pem {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] compute_monitors               = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] config_dir                     = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] config_drive_format            = iso9660 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] config_source                  = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] console_host                   = user {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] control_exchange               = nova {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cpu_allocation_ratio           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] daemon                         = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] debug                          = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] default_access_ip_network_name = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] default_availability_zone      = nova {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] default_ephemeral_format       = ext4 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] default_schedule_zone          = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] disk_allocation_ratio          = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] enable_new_services            = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] enabled_ssl_apis               = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] flat_injected                  = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] force_config_drive             = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] force_raw_images               = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] graceful_shutdown_timeout      = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] heal_instance_info_cache_interval = 60 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] host                           = user {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] instance_build_timeout         = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] instance_delete_interval       = 300 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] instance_name_template         = instance-%08x {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] instance_usage_audit           = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] instance_usage_audit_period    = month {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] internal_service_availability_zone = internal {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] key                            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] live_migration_retry_count     = 30 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] log_config_append              = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] log_dir                        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] log_file                       = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] log_options                    = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] log_rotate_interval            = 1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] log_rotate_interval_type       = days {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] log_rotation_type              = none {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] long_rpc_timeout               = 1800 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] max_concurrent_builds          = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] max_concurrent_live_migrations = 1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] max_concurrent_snapshots       = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] max_local_block_devices        = 3 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] max_logfile_count              = 30 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] max_logfile_size_mb            = 200 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] maximum_instance_delete_attempts = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] metadata_listen                = 0.0.0.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] metadata_listen_port           = 8775 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] metadata_workers               = 3 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] migrate_max_retries            = -1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] mkisofs_cmd                    = genisoimage {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] my_ip                          = 10.0.0.210 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] network_allocate_retries       = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] osapi_compute_listen_port      = 8774 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] osapi_compute_unique_server_name_scope =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] osapi_compute_workers          = 3 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] password_length                = 12 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] periodic_enable                = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] periodic_fuzzy_delay           = 60 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] pointer_model                  = ps2mouse {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] preallocate_images             = none {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] publish_errors                 = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] pybasedir                      = /opt/stack/nova {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ram_allocation_ratio           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] rate_limit_burst               = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] rate_limit_except_level        = CRITICAL {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] rate_limit_interval            = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] reboot_timeout                 = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] reclaim_instance_interval      = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] record                         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] reimage_timeout_per_gb         = 20 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] report_interval                = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] rescue_timeout                 = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] reserved_host_cpus             = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] reserved_host_disk_mb          = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] reserved_host_memory_mb        = 512 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] reserved_huge_pages            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] resize_confirm_window          = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] resize_fs_using_block_device   = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] resume_guests_state_on_host_boot = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] rpc_response_timeout           = 60 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] run_external_periodic_tasks    = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] running_deleted_instance_action = reap {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] running_deleted_instance_timeout = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] scheduler_instance_sync_interval = 120 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] service_down_time              = 60 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] servicegroup_driver            = db {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] shelved_offload_time           = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] shelved_poll_interval          = 3600 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] shutdown_timeout               = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] source_is_ipv6                 = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ssl_only                       = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] state_path                     = /opt/stack/data/nova {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] sync_power_state_interval      = 600 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] sync_power_state_pool_size     = 1000 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] syslog_log_facility            = LOG_USER {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] tempdir                        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] timeout_nbd                    = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] transport_url                  = **** {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] update_resources_interval      = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] use_cow_images                 = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] use_eventlog                   = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] use_journal                    = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] use_json                       = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] use_rootwrap_daemon            = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] use_stderr                     = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] use_syslog                     = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vcpu_pin_set                   = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vif_plugging_is_fatal          = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vif_plugging_timeout           = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] virt_mkfs                      = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] volume_usage_poll_interval     = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] watch_log_file                 = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] web                            = /usr/share/spice-html5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_concurrency.disable_process_locking = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.auth_strategy              = keystone {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.compute_link_prefix        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.dhcp_domain                = novalocal {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.enable_instance_password   = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.glance_link_prefix         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.instance_list_per_project_cells = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.list_records_by_skipping_down_cells = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.local_metadata_per_cell    = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.max_limit                  = 1000 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.metadata_cache_expiration  = 15 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.neutron_default_tenant_id  = default {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.use_forwarded_for          = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.use_neutron_default_nets   = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.vendordata_dynamic_targets = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.vendordata_jsonfile_path   = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.backend_argument         = **** {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.config_prefix            = cache.oslo {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.dead_timeout             = 60.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.debug_cache_backend      = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.enable_retry_client      = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.enable_socket_keepalive  = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.enabled                  = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.expiration_time          = 600 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.hashclient_retry_attempts = 2 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.memcache_dead_retry      = 300 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.memcache_password        =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.memcache_sasl_enabled    = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.memcache_username        =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.proxies                  = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.retry_attempts           = 2 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.retry_delay              = 0.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.socket_keepalive_count   = 1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.socket_keepalive_idle    = 1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.socket_keepalive_interval = 1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.tls_allowed_ciphers      = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.tls_cafile               = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.tls_certfile             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.tls_enabled              = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cache.tls_keyfile              = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.auth_section            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.auth_type               = password {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:55 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.cafile                  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.certfile                = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.collect_timing          = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.cross_az_attach         = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.debug                   = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.endpoint_template       = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.http_retries            = 3 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.insecure                = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.keyfile                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.os_region_name          = RegionOne {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.split_loggers           = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cinder.timeout                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] compute.cpu_dedicated_set      = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] compute.cpu_shared_set         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] compute.image_type_exclude_list = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] compute.resource_provider_association_refresh = 300 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] compute.shutdown_retry_interval = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] conductor.workers              = 3 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] console.allowed_origins        = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] console.ssl_ciphers            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] console.ssl_minimum_version    = default {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] consoleauth.token_ttl          = 600 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.cafile                  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.certfile                = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.collect_timing          = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.connect_retries         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.connect_retry_delay     = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.endpoint_override       = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.insecure                = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.keyfile                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.max_version             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.min_version             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.region_name             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.service_name            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.service_type            = accelerator {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.split_loggers           = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.status_code_retries     = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.status_code_retry_delay = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.timeout                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] cyborg.version                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.backend               = sqlalchemy {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.connection            = **** {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.connection_debug      = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.connection_parameters =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.connection_recycle_time = 3600 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.connection_trace      = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.db_inc_retry_interval = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.db_max_retries        = 20 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.db_max_retry_interval = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.db_retry_interval     = 1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.max_overflow          = 50 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.max_pool_size         = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.max_retries           = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.mysql_enable_ndb      = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.mysql_wsrep_sync_wait = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.pool_timeout          = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.retry_interval        = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.slave_connection      = **** {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] database.sqlite_synchronous    = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.backend           = sqlalchemy {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.connection        = **** {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.connection_debug  = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.connection_parameters =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.connection_recycle_time = 3600 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.connection_trace  = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.db_inc_retry_interval = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.db_max_retries    = 20 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.db_max_retry_interval = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.db_retry_interval = 1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.max_overflow      = 50 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.max_pool_size     = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.max_retries       = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.mysql_enable_ndb  = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.pool_timeout      = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.retry_interval    = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.slave_connection  = **** {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] api_database.sqlite_synchronous = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] devices.enabled_mdev_types     = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ephemeral_storage_encryption.enabled = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.api_servers             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.cafile                  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.certfile                = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.collect_timing          = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.connect_retries         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.connect_retry_delay     = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.debug                   = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.default_trusted_certificate_ids = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.enable_certificate_validation = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.enable_rbd_download     = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.endpoint_override       = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.insecure                = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.keyfile                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.max_version             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.min_version             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.num_retries             = 3 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.rbd_ceph_conf           =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.rbd_connect_timeout     = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.rbd_pool                =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.rbd_user                =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.region_name             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.service_name            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.service_type            = image {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.split_loggers           = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.status_code_retries     = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.status_code_retry_delay = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.timeout                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.verify_glance_signatures = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] glance.version                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] guestfs.debug                  = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.config_drive_cdrom      = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.config_drive_inject_password = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.enable_remotefx         = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.instances_path_share    =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.limit_cpu_features      = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.use_multipath_io        = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.vswitch_name            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] mks.enabled                    = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] image_cache.manager_interval   = 2400 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] image_cache.precache_concurrency = 1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] image_cache.remove_unused_base_images = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] image_cache.subdirectory_name  = _base {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.api_max_retries         = 60 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.api_retry_interval      = 2 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.auth_section            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.auth_type               = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.cafile                  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.certfile                = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.collect_timing          = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.connect_retries         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.connect_retry_delay     = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.endpoint_override       = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.insecure                = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.keyfile                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.max_version             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.min_version             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.partition_key           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.peer_list               = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.region_name             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.serial_console_state_timeout = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.service_name            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.service_type            = baremetal {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.split_loggers           = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.status_code_retries     = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.status_code_retry_delay = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.timeout                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ironic.version                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] key_manager.fixed_key          = **** {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.barbican_api_version  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.barbican_endpoint     = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.barbican_endpoint_type = public {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.barbican_region_name  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.cafile                = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.certfile              = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.collect_timing        = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.insecure              = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.keyfile               = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.number_of_retries     = 60 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.retry_delay           = 1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.send_service_user_token = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.split_loggers         = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.timeout               = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.verify_ssl            = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican.verify_ssl_path       = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican_service_user.auth_section = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican_service_user.auth_type = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican_service_user.cafile   = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican_service_user.certfile = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican_service_user.collect_timing = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican_service_user.insecure = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican_service_user.keyfile  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican_service_user.split_loggers = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] barbican_service_user.timeout  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.approle_role_id          = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.approle_secret_id        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.cafile                   = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.certfile                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.collect_timing           = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.insecure                 = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.keyfile                  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.kv_mountpoint            = secret {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.kv_version               = 2 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.namespace                = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.root_token_id            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.split_loggers            = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.ssl_ca_crt_file          = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.timeout                  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.use_ssl                  = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.cafile                = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.certfile              = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.collect_timing        = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.connect_retries       = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.connect_retry_delay   = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.endpoint_override     = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.insecure              = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.keyfile               = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.max_version           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.min_version           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.region_name           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.service_name          = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.service_type          = identity {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.split_loggers         = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.status_code_retries   = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.status_code_retry_delay = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.timeout               = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] keystone.version               = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.connection_uri         =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.cpu_mode               = custom {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: WARNING oslo_config.cfg [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.cpu_power_governor_high = performance {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.cpu_power_management   = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.device_detach_attempts = 8 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.device_detach_timeout  = 20 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.disk_cachemodes        = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.disk_prefix            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.enabled_perf_events    = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.file_backed_memory     = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.gid_maps               = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.hw_disk_discard        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.hw_machine_type        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.images_rbd_pool        = rbd {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.images_type            = default {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.images_volume_group    = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.inject_key             = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.inject_partition       = -2 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.inject_password        = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.iscsi_iface            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.iser_use_multipath     = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.live_migration_downtime = 500 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.live_migration_inbound_addr = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.live_migration_scheme  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.live_migration_timeout_action = abort {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.live_migration_tunnelled = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: WARNING oslo_config.cfg [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 13 21:40:56 user nova-compute[71325]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 13 21:40:56 user nova-compute[71325]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 13 21:40:56 user nova-compute[71325]: and ``live_migration_inbound_addr`` respectively.
Apr 13 21:40:56 user nova-compute[71325]: ).  Its value may be silently ignored in the future.
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.live_migration_with_native_tls = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.max_queues             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.nfs_mount_options      = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.num_pcie_ports         = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.pmem_namespaces        = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.quobyte_client_cfg     = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.rbd_secret_uuid        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.rbd_user               = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.rescue_image_id        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.rescue_kernel_id       = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.rx_queue_size          = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.smbfs_mount_options    =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.snapshot_compression   = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.snapshot_image_format  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.sparse_logical_volumes = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.swtpm_enabled          = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.swtpm_group            = tss {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.swtpm_user             = tss {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.sysinfo_serial         = unique {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.tx_queue_size          = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.uid_maps               = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.use_virtio_for_bridges = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.virt_type              = kvm {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.volume_clear           = zero {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.volume_clear_size      = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.volume_use_multipath   = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.vzstorage_cache_path   = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.auth_section           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.auth_type              = password {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.cafile                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.certfile               = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.collect_timing         = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.connect_retries        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.connect_retry_delay    = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.default_floating_pool  = public {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.endpoint_override      = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.extension_sync_interval = 600 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.http_retries           = 3 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.insecure               = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.keyfile                = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.max_version            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.min_version            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.ovs_bridge             = br-int {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.physnets               = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.region_name            = RegionOne {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.service_metadata_proxy = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.service_name           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.service_type           = network {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.split_loggers          = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.status_code_retries    = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.status_code_retry_delay = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.timeout                = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] neutron.version                = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] notifications.bdms_in_notifications = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] notifications.default_level    = INFO {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] notifications.notification_format = unversioned {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] notifications.notify_on_state_change = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] pci.alias                      = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] pci.device_spec                = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] pci.report_in_placement        = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.auth_section         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.auth_type            = password {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.cafile               = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.certfile             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.collect_timing       = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.connect_retries      = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.connect_retry_delay  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.default_domain_id    = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.default_domain_name  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.domain_id            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.domain_name          = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.endpoint_override    = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.insecure             = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.keyfile              = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.max_version          = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.min_version          = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.password             = **** {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.project_domain_id    = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.project_domain_name  = Default {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.project_id           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.project_name         = service {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.region_name          = RegionOne {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.service_name         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.service_type         = placement {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.split_loggers        = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.status_code_retries  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.status_code_retry_delay = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.system_scope         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.timeout              = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.trust_id             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.user_domain_id       = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.user_domain_name     = Default {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.user_id              = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.username             = placement {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] placement.version              = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] quota.cores                    = 20 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] quota.count_usage_from_placement = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] quota.injected_file_content_bytes = 10240 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] quota.injected_file_path_length = 255 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] quota.injected_files           = 5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] quota.instances                = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] quota.key_pairs                = 100 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] quota.metadata_items           = 128 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] quota.ram                      = 51200 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] quota.recheck_quota            = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] quota.server_group_members     = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] quota.server_groups            = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] rdp.enabled                    = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] scheduler.image_metadata_prefilter = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] scheduler.max_attempts         = 3 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] scheduler.max_placement_results = 1000 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] scheduler.workers              = 3 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.host_subset_size = 1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.isolated_hosts = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.isolated_images = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.pci_in_placement = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.track_instance_changes = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] metrics.required               = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] metrics.weight_multiplier      = 1.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] metrics.weight_setting         = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] serial_console.enabled         = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] serial_console.port_range      = 10000:20000 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] serial_console.serialproxy_port = 6083 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] service_user.auth_section      = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] service_user.auth_type         = password {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] service_user.cafile            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] service_user.certfile          = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] service_user.collect_timing    = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] service_user.insecure          = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] service_user.keyfile           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] service_user.send_service_user_token = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] service_user.split_loggers     = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] service_user.timeout           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] spice.agent_enabled            = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] spice.enabled                  = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] spice.html5proxy_port          = 6082 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] spice.image_compression        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] spice.jpeg_compression         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] spice.playback_compression     = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] spice.server_listen            = 127.0.0.1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] spice.streaming_mode           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] spice.zlib_compression         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] upgrade_levels.baseapi         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] upgrade_levels.cert            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] upgrade_levels.compute         = auto {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] upgrade_levels.conductor       = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] upgrade_levels.scheduler       = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vendordata_dynamic_auth.cafile = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vendordata_dynamic_auth.certfile = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vendordata_dynamic_auth.insecure = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vendordata_dynamic_auth.timeout = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.api_retry_count         = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.ca_file                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.cache_prefix            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.cluster_name            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.connection_pool_size    = 10 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.console_delay_seconds   = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.datastore_regex         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.host_ip                 = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.host_password           = **** {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.host_port               = 443 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.host_username           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.insecure                = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.integration_bridge      = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.maximum_objects         = 100 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.pbm_default_policy      = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.pbm_enabled             = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.pbm_wsdl_location       = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.serial_port_proxy_uri   = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.serial_port_service_uri = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.task_poll_interval      = 0.5 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.use_linked_clone        = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.vnc_keymap              = en-us {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.vnc_port                = 5900 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vmware.vnc_port_total          = 10000 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vnc.auth_schemes               = ['none'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vnc.enabled                    = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vnc.novncproxy_port            = 6080 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vnc.vencrypt_ca_certs          = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vnc.vencrypt_client_cert       = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vnc.vencrypt_client_key        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.disable_rootwrap   = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.enable_numa_live_migration = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.libvirt_disable_apic = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] wsgi.client_socket_timeout     = 900 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] wsgi.default_pool_size         = 1000 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] wsgi.keep_alive                = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] wsgi.max_header_line           = 16384 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] wsgi.ssl_ca_file               = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] wsgi.ssl_cert_file             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] wsgi.ssl_key_file              = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] wsgi.tcp_keepidle              = 600 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] zvm.ca_file                    = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] zvm.cloud_connector_url        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] zvm.reachable_timeout          = 300 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_policy.enforce_new_defaults = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_policy.enforce_scope      = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_policy.policy_default_rule = default {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] profiler.connection_string     = messaging:// {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] profiler.enabled               = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] profiler.es_doc_type           = notification {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] profiler.es_scroll_size        = 10000 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] profiler.es_scroll_time        = 2m {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] profiler.filter_error_trace    = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] profiler.sentinel_service_name = mymaster {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] profiler.socket_timeout        = 0.1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] profiler.trace_sqlalchemy      = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] remote_debug.host              = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] remote_debug.port              = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_notifications.retry = -1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.auth_section        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.auth_type           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.cafile              = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.certfile            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.collect_timing      = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.connect_retries     = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.connect_retry_delay = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.endpoint_id         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.endpoint_override   = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.insecure            = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.keyfile             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.max_version         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.min_version         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.region_name         = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.service_name        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.service_type        = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.split_loggers       = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.status_code_retries = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.status_code_retry_delay = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.timeout             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.valid_interfaces    = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_limit.version             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_reports.file_event_handler = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] oslo_reports.log_dir           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vif_plug_ovs_privileged.group  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] vif_plug_ovs_privileged.user   = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_vif_ovs.isolate_vif         = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] os_brick.lock_path             = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] privsep_osbrick.capabilities   = [21] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] privsep_osbrick.group          = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] privsep_osbrick.helper_command = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] privsep_osbrick.user           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] nova_sys_admin.group           = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] nova_sys_admin.helper_command  = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] nova_sys_admin.user            = None {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG oslo_service.service [None req-4636c534-e990-402f-90ba-b0ce3af435c0 None None] ******************************************************************************** {{(pid=71325) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 13 21:40:56 user nova-compute[71325]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 13 21:40:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Starting native event thread {{(pid=71325) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Starting green dispatch thread {{(pid=71325) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Starting connection event dispatch thread {{(pid=71325) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Connecting to libvirt: qemu:///system {{(pid=71325) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fc5d40c2680> {{(pid=71325) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 13 21:40:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fc5d40c2680> {{(pid=71325) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 13 21:40:56 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Connection event '1' reason 'None'
Apr 13 21:40:56 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 13 21:40:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.mount [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Initialising _HostMountState generation 0 {{(pid=71325) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 13 21:41:03 user nova-compute[71325]: INFO nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Libvirt host capabilities <capabilities>
Apr 13 21:41:03 user nova-compute[71325]:   <host>
Apr 13 21:41:03 user nova-compute[71325]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 13 21:41:03 user nova-compute[71325]:     <cpu>
Apr 13 21:41:03 user nova-compute[71325]:       <arch>x86_64</arch>
Apr 13 21:41:03 user nova-compute[71325]:       <model>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <vendor>Intel</vendor>
Apr 13 21:41:03 user nova-compute[71325]:       <microcode version='1070'/>
Apr 13 21:41:03 user nova-compute[71325]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 13 21:41:03 user nova-compute[71325]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature name='ss'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature name='vmx'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature name='pcid'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature name='osxsave'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature name='hypervisor'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature name='arat'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature name='tsc_adjust'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature name='md-clear'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature name='stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature name='arch-capabilities'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature name='ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature name='invtsc'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature name='rsba'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature name='skip-l1dfl-vmentry'/>
Apr 13 21:41:03 user nova-compute[71325]:       <pages unit='KiB' size='4'/>
Apr 13 21:41:03 user nova-compute[71325]:       <pages unit='KiB' size='2048'/>
Apr 13 21:41:03 user nova-compute[71325]:     </cpu>
Apr 13 21:41:03 user nova-compute[71325]:     <power_management>
Apr 13 21:41:03 user nova-compute[71325]:       <suspend_mem/>
Apr 13 21:41:03 user nova-compute[71325]:       <suspend_disk/>
Apr 13 21:41:03 user nova-compute[71325]:       <suspend_hybrid/>
Apr 13 21:41:03 user nova-compute[71325]:     </power_management>
Apr 13 21:41:03 user nova-compute[71325]:     <iommu support='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     <migration_features>
Apr 13 21:41:03 user nova-compute[71325]:       <live/>
Apr 13 21:41:03 user nova-compute[71325]:       <uri_transports>
Apr 13 21:41:03 user nova-compute[71325]:         <uri_transport>tcp</uri_transport>
Apr 13 21:41:03 user nova-compute[71325]:         <uri_transport>rdma</uri_transport>
Apr 13 21:41:03 user nova-compute[71325]:       </uri_transports>
Apr 13 21:41:03 user nova-compute[71325]:     </migration_features>
Apr 13 21:41:03 user nova-compute[71325]:     <topology>
Apr 13 21:41:03 user nova-compute[71325]:       <cells num='2'>
Apr 13 21:41:03 user nova-compute[71325]:         <cell id='0'>
Apr 13 21:41:03 user nova-compute[71325]:           <memory unit='KiB'>8189224</memory>
Apr 13 21:41:03 user nova-compute[71325]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 13 21:41:03 user nova-compute[71325]:           <pages unit='KiB' size='2048'>0</pages>
Apr 13 21:41:03 user nova-compute[71325]:           <distances>
Apr 13 21:41:03 user nova-compute[71325]:             <sibling id='0' value='10'/>
Apr 13 21:41:03 user nova-compute[71325]:             <sibling id='1' value='20'/>
Apr 13 21:41:03 user nova-compute[71325]:           </distances>
Apr 13 21:41:03 user nova-compute[71325]:           <cpus num='6'>
Apr 13 21:41:03 user nova-compute[71325]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 13 21:41:03 user nova-compute[71325]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 13 21:41:03 user nova-compute[71325]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 13 21:41:03 user nova-compute[71325]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 13 21:41:03 user nova-compute[71325]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 13 21:41:03 user nova-compute[71325]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 13 21:41:03 user nova-compute[71325]:           </cpus>
Apr 13 21:41:03 user nova-compute[71325]:         </cell>
Apr 13 21:41:03 user nova-compute[71325]:         <cell id='1'>
Apr 13 21:41:03 user nova-compute[71325]:           <memory unit='KiB'>8218764</memory>
Apr 13 21:41:03 user nova-compute[71325]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 13 21:41:03 user nova-compute[71325]:           <pages unit='KiB' size='2048'>0</pages>
Apr 13 21:41:03 user nova-compute[71325]:           <distances>
Apr 13 21:41:03 user nova-compute[71325]:             <sibling id='0' value='20'/>
Apr 13 21:41:03 user nova-compute[71325]:             <sibling id='1' value='10'/>
Apr 13 21:41:03 user nova-compute[71325]:           </distances>
Apr 13 21:41:03 user nova-compute[71325]:           <cpus num='6'>
Apr 13 21:41:03 user nova-compute[71325]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 13 21:41:03 user nova-compute[71325]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 13 21:41:03 user nova-compute[71325]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 13 21:41:03 user nova-compute[71325]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 13 21:41:03 user nova-compute[71325]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 13 21:41:03 user nova-compute[71325]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 13 21:41:03 user nova-compute[71325]:           </cpus>
Apr 13 21:41:03 user nova-compute[71325]:         </cell>
Apr 13 21:41:03 user nova-compute[71325]:       </cells>
Apr 13 21:41:03 user nova-compute[71325]:     </topology>
Apr 13 21:41:03 user nova-compute[71325]:     <cache>
Apr 13 21:41:03 user nova-compute[71325]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 13 21:41:03 user nova-compute[71325]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 13 21:41:03 user nova-compute[71325]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 13 21:41:03 user nova-compute[71325]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 13 21:41:03 user nova-compute[71325]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 13 21:41:03 user nova-compute[71325]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 13 21:41:03 user nova-compute[71325]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 13 21:41:03 user nova-compute[71325]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 13 21:41:03 user nova-compute[71325]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 13 21:41:03 user nova-compute[71325]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 13 21:41:03 user nova-compute[71325]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 13 21:41:03 user nova-compute[71325]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 13 21:41:03 user nova-compute[71325]:     </cache>
Apr 13 21:41:03 user nova-compute[71325]:     <secmodel>
Apr 13 21:41:03 user nova-compute[71325]:       <model>apparmor</model>
Apr 13 21:41:03 user nova-compute[71325]:       <doi>0</doi>
Apr 13 21:41:03 user nova-compute[71325]:     </secmodel>
Apr 13 21:41:03 user nova-compute[71325]:     <secmodel>
Apr 13 21:41:03 user nova-compute[71325]:       <model>dac</model>
Apr 13 21:41:03 user nova-compute[71325]:       <doi>0</doi>
Apr 13 21:41:03 user nova-compute[71325]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 13 21:41:03 user nova-compute[71325]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 13 21:41:03 user nova-compute[71325]:     </secmodel>
Apr 13 21:41:03 user nova-compute[71325]:   </host>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='alpha'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>64</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>clipper</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='armv6l'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>spitz</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>nuri</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>kzm</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sx1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>z2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>tosa</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>n810</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>n800</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>terrier</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>midway</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>microbit</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>verdex</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>highbank</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>akita</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>connex</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>collie</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='armv7l'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>spitz</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>nuri</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>kzm</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sx1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>z2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>tosa</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>n810</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>n800</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>terrier</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>midway</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>microbit</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>verdex</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>highbank</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>akita</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>connex</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>collie</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='aarch64'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>64</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>spitz</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>nuri</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>kzm</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sx1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>z2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>tosa</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>n810</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>n800</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>terrier</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>midway</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>microbit</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>verdex</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>raspi3b</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>highbank</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>akita</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>connex</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>collie</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <acpi default='on' toggle='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='cris'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='i686'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>x-remote</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>isapc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>microvm</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='kvm'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <pae/>
Apr 13 21:41:03 user nova-compute[71325]:       <nonpae/>
Apr 13 21:41:03 user nova-compute[71325]:       <acpi default='on' toggle='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:       <apic default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='m68k'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>an5206</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>q800</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>next-cube</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='microblaze'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='microblazeel'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='mips'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='16'>malta</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='mipsel'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='16'>malta</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='mips64'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>64</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='16'>malta</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>pica61</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>magnum</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='mips64el'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>64</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='16'>malta</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>pica61</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>magnum</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='16'>boston</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='ppc'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mac99</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>40p</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>taihu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='ppc64'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>64</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2048'>powernv9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>taihu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2048'>powernv10</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>40p</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mac99</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2048'>powernv8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='ppc64le'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>64</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2048'>powernv9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>taihu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2048'>powernv10</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>40p</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>mac99</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2048'>powernv8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='riscv32'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='8'>spike</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>opentitan</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='5'>sifive_u</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sifive_e</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='8'>virt</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='riscv64'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>64</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='8'>spike</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='5'>sifive_u</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>shakti_c</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sifive_e</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='8'>virt</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='s390x'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>64</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='sh4'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>shix</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>r2d</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='sh4eb'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>64</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>shix</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>r2d</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='sparc'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>SS-5</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>SS-20</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>LX</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>SS-4</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>SS-10</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>Voyager</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='sparc64'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>64</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sun4u</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>niagara</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>sun4v</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='x86_64'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>64</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>x-remote</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='1'>isapc</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>microvm</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='kvm'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <acpi default='on' toggle='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:       <apic default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='xtensa'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>sim</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>kc705</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>ml605</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>virt</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>lx200</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>lx60</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]:   <guest>
Apr 13 21:41:03 user nova-compute[71325]:     <os_type>hvm</os_type>
Apr 13 21:41:03 user nova-compute[71325]:     <arch name='xtensaeb'>
Apr 13 21:41:03 user nova-compute[71325]:       <wordsize>32</wordsize>
Apr 13 21:41:03 user nova-compute[71325]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='4'>sim</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>kc705</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>ml605</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>virt</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>lx200</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>lx60</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 13 21:41:03 user nova-compute[71325]:       <domain type='qemu'/>
Apr 13 21:41:03 user nova-compute[71325]:     </arch>
Apr 13 21:41:03 user nova-compute[71325]:     <features>
Apr 13 21:41:03 user nova-compute[71325]:       <cpuselection/>
Apr 13 21:41:03 user nova-compute[71325]:       <deviceboot/>
Apr 13 21:41:03 user nova-compute[71325]:       <disksnapshot default='on' toggle='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     </features>
Apr 13 21:41:03 user nova-compute[71325]:   </guest>
Apr 13 21:41:03 user nova-compute[71325]: </capabilities>
Apr 13 21:41:03 user nova-compute[71325]: 
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 13 21:41:03 user nova-compute[71325]: <domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 21:41:03 user nova-compute[71325]:   <domain>kvm</domain>
Apr 13 21:41:03 user nova-compute[71325]:   <machine>pc-q35-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:   <arch>i686</arch>
Apr 13 21:41:03 user nova-compute[71325]:   <vcpu max='288'/>
Apr 13 21:41:03 user nova-compute[71325]:   <iothreads supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:   <os supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='firmware'/>
Apr 13 21:41:03 user nova-compute[71325]:     <loader supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>rom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pflash</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='readonly'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>yes</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='secure'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </loader>
Apr 13 21:41:03 user nova-compute[71325]:   </os>
Apr 13 21:41:03 user nova-compute[71325]:   <cpu>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-passthrough' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='hostPassthroughMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='maximum' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='maximumMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>on</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-model' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <vendor>Intel</vendor>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ss'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='vmx'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='pcid'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='hypervisor'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arat'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='umip'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='md-clear'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibpb'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibrs'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='erms'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='lm'/>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='custom' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>qemu64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>qemu32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>phenom</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>n270</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>kvm64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>kvm32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>coreduo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>core2duo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>athlon</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Westmere</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Snowridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Penryn</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G5</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G4</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G1</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Nehalem</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Rome</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Milan</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Dhyana</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cooperlake</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Conroe</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>486</model>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:   </cpu>
Apr 13 21:41:03 user nova-compute[71325]:   <memoryBacking supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='sourceType'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>file</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>anonymous</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>memfd</value>
Apr 13 21:41:03 user nova-compute[71325]:     </enum>
Apr 13 21:41:03 user nova-compute[71325]:   </memoryBacking>
Apr 13 21:41:03 user nova-compute[71325]:   <devices>
Apr 13 21:41:03 user nova-compute[71325]:     <disk supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='diskDevice'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>disk</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cdrom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>floppy</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>lun</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='bus'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>fdc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sata</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </disk>
Apr 13 21:41:03 user nova-compute[71325]:     <graphics supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sdl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vnc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>spice</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egl-headless</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </graphics>
Apr 13 21:41:03 user nova-compute[71325]:     <video supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='modelType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cirrus</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vmvga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>qxl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>none</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>bochs</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>ramfb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </video>
Apr 13 21:41:03 user nova-compute[71325]:     <hostdev supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='mode'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>subsystem</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='startupPolicy'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>default</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>mandatory</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>requisite</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>optional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='subsysType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pci</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='capsType'/>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='pciBackend'/>
Apr 13 21:41:03 user nova-compute[71325]:     </hostdev>
Apr 13 21:41:03 user nova-compute[71325]:     <rng supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>random</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egd</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>builtin</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </rng>
Apr 13 21:41:03 user nova-compute[71325]:     <filesystem supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='driverType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>path</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>handle</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtiofs</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </filesystem>
Apr 13 21:41:03 user nova-compute[71325]:     <tpm supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-tis</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-crb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>passthrough</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>emulator</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </tpm>
Apr 13 21:41:03 user nova-compute[71325]:   </devices>
Apr 13 21:41:03 user nova-compute[71325]:   <features>
Apr 13 21:41:03 user nova-compute[71325]:     <gic supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     <vmcoreinfo supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <genid supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backingStoreInput supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backup supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <sev supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:   </features>
Apr 13 21:41:03 user nova-compute[71325]: </domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:  {{(pid=71325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 13 21:41:03 user nova-compute[71325]: <domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 21:41:03 user nova-compute[71325]:   <domain>kvm</domain>
Apr 13 21:41:03 user nova-compute[71325]:   <machine>pc-i440fx-jammy</machine>
Apr 13 21:41:03 user nova-compute[71325]:   <arch>i686</arch>
Apr 13 21:41:03 user nova-compute[71325]:   <vcpu max='255'/>
Apr 13 21:41:03 user nova-compute[71325]:   <iothreads supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:   <os supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='firmware'/>
Apr 13 21:41:03 user nova-compute[71325]:     <loader supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>rom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pflash</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='readonly'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>yes</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='secure'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </loader>
Apr 13 21:41:03 user nova-compute[71325]:   </os>
Apr 13 21:41:03 user nova-compute[71325]:   <cpu>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-passthrough' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='hostPassthroughMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='maximum' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='maximumMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>on</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-model' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <vendor>Intel</vendor>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ss'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='vmx'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='pcid'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='hypervisor'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arat'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='umip'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='md-clear'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibpb'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibrs'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='erms'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='lm'/>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='custom' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>qemu64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>qemu32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>phenom</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>n270</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>kvm64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>kvm32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>coreduo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>core2duo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>athlon</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Westmere</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Snowridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Penryn</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G5</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G4</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G1</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Nehalem</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Rome</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Milan</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Dhyana</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cooperlake</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Conroe</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>486</model>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:   </cpu>
Apr 13 21:41:03 user nova-compute[71325]:   <memoryBacking supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='sourceType'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>file</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>anonymous</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>memfd</value>
Apr 13 21:41:03 user nova-compute[71325]:     </enum>
Apr 13 21:41:03 user nova-compute[71325]:   </memoryBacking>
Apr 13 21:41:03 user nova-compute[71325]:   <devices>
Apr 13 21:41:03 user nova-compute[71325]:     <disk supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='diskDevice'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>disk</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cdrom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>floppy</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>lun</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='bus'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>ide</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>fdc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sata</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </disk>
Apr 13 21:41:03 user nova-compute[71325]:     <graphics supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sdl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vnc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>spice</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egl-headless</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </graphics>
Apr 13 21:41:03 user nova-compute[71325]:     <video supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='modelType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cirrus</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vmvga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>qxl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>none</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>bochs</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>ramfb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </video>
Apr 13 21:41:03 user nova-compute[71325]:     <hostdev supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='mode'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>subsystem</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='startupPolicy'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>default</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>mandatory</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>requisite</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>optional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='subsysType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pci</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='capsType'/>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='pciBackend'/>
Apr 13 21:41:03 user nova-compute[71325]:     </hostdev>
Apr 13 21:41:03 user nova-compute[71325]:     <rng supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>random</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egd</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>builtin</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </rng>
Apr 13 21:41:03 user nova-compute[71325]:     <filesystem supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='driverType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>path</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>handle</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtiofs</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </filesystem>
Apr 13 21:41:03 user nova-compute[71325]:     <tpm supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-tis</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-crb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>passthrough</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>emulator</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </tpm>
Apr 13 21:41:03 user nova-compute[71325]:   </devices>
Apr 13 21:41:03 user nova-compute[71325]:   <features>
Apr 13 21:41:03 user nova-compute[71325]:     <gic supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     <vmcoreinfo supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <genid supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backingStoreInput supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backup supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <sev supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:   </features>
Apr 13 21:41:03 user nova-compute[71325]: </domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:  {{(pid=71325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 13 21:41:03 user nova-compute[71325]: <domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 21:41:03 user nova-compute[71325]:   <domain>kvm</domain>
Apr 13 21:41:03 user nova-compute[71325]:   <machine>pc-i440fx-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:   <arch>i686</arch>
Apr 13 21:41:03 user nova-compute[71325]:   <vcpu max='255'/>
Apr 13 21:41:03 user nova-compute[71325]:   <iothreads supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:   <os supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='firmware'/>
Apr 13 21:41:03 user nova-compute[71325]:     <loader supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>rom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pflash</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='readonly'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>yes</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='secure'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </loader>
Apr 13 21:41:03 user nova-compute[71325]:   </os>
Apr 13 21:41:03 user nova-compute[71325]:   <cpu>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-passthrough' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='hostPassthroughMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='maximum' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='maximumMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>on</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-model' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <vendor>Intel</vendor>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ss'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='vmx'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='pcid'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='hypervisor'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arat'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='umip'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='md-clear'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibpb'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibrs'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='erms'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='lm'/>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='custom' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>qemu64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>qemu32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>phenom</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>n270</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>kvm64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>kvm32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>coreduo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>core2duo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>athlon</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Westmere</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Snowridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Penryn</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G5</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G4</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G1</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Nehalem</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Rome</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Milan</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Dhyana</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cooperlake</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Conroe</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>486</model>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:   </cpu>
Apr 13 21:41:03 user nova-compute[71325]:   <memoryBacking supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='sourceType'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>file</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>anonymous</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>memfd</value>
Apr 13 21:41:03 user nova-compute[71325]:     </enum>
Apr 13 21:41:03 user nova-compute[71325]:   </memoryBacking>
Apr 13 21:41:03 user nova-compute[71325]:   <devices>
Apr 13 21:41:03 user nova-compute[71325]:     <disk supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='diskDevice'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>disk</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cdrom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>floppy</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>lun</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='bus'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>ide</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>fdc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sata</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </disk>
Apr 13 21:41:03 user nova-compute[71325]:     <graphics supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sdl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vnc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>spice</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egl-headless</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </graphics>
Apr 13 21:41:03 user nova-compute[71325]:     <video supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='modelType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cirrus</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vmvga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>qxl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>none</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>bochs</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>ramfb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </video>
Apr 13 21:41:03 user nova-compute[71325]:     <hostdev supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='mode'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>subsystem</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='startupPolicy'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>default</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>mandatory</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>requisite</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>optional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='subsysType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pci</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='capsType'/>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='pciBackend'/>
Apr 13 21:41:03 user nova-compute[71325]:     </hostdev>
Apr 13 21:41:03 user nova-compute[71325]:     <rng supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>random</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egd</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>builtin</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </rng>
Apr 13 21:41:03 user nova-compute[71325]:     <filesystem supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='driverType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>path</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>handle</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtiofs</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </filesystem>
Apr 13 21:41:03 user nova-compute[71325]:     <tpm supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-tis</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-crb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>passthrough</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>emulator</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </tpm>
Apr 13 21:41:03 user nova-compute[71325]:   </devices>
Apr 13 21:41:03 user nova-compute[71325]:   <features>
Apr 13 21:41:03 user nova-compute[71325]:     <gic supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     <vmcoreinfo supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <genid supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backingStoreInput supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backup supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <sev supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:   </features>
Apr 13 21:41:03 user nova-compute[71325]: </domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:  {{(pid=71325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 13 21:41:03 user nova-compute[71325]: <domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 21:41:03 user nova-compute[71325]:   <domain>kvm</domain>
Apr 13 21:41:03 user nova-compute[71325]:   <machine>pc-q35-jammy</machine>
Apr 13 21:41:03 user nova-compute[71325]:   <arch>i686</arch>
Apr 13 21:41:03 user nova-compute[71325]:   <vcpu max='288'/>
Apr 13 21:41:03 user nova-compute[71325]:   <iothreads supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:   <os supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='firmware'/>
Apr 13 21:41:03 user nova-compute[71325]:     <loader supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>rom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pflash</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='readonly'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>yes</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='secure'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </loader>
Apr 13 21:41:03 user nova-compute[71325]:   </os>
Apr 13 21:41:03 user nova-compute[71325]:   <cpu>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-passthrough' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='hostPassthroughMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='maximum' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='maximumMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>on</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-model' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <vendor>Intel</vendor>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ss'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='vmx'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='pcid'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='hypervisor'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arat'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='umip'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='md-clear'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibpb'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibrs'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='erms'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='lm'/>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='custom' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>qemu64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>qemu32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>phenom</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>n270</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>kvm64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>kvm32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>coreduo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>core2duo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>athlon</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Westmere</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Snowridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Penryn</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G5</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G4</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G1</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Nehalem</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Rome</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Milan</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Dhyana</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cooperlake</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Conroe</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>486</model>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:   </cpu>
Apr 13 21:41:03 user nova-compute[71325]:   <memoryBacking supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='sourceType'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>file</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>anonymous</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>memfd</value>
Apr 13 21:41:03 user nova-compute[71325]:     </enum>
Apr 13 21:41:03 user nova-compute[71325]:   </memoryBacking>
Apr 13 21:41:03 user nova-compute[71325]:   <devices>
Apr 13 21:41:03 user nova-compute[71325]:     <disk supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='diskDevice'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>disk</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cdrom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>floppy</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>lun</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='bus'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>fdc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sata</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </disk>
Apr 13 21:41:03 user nova-compute[71325]:     <graphics supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sdl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vnc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>spice</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egl-headless</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </graphics>
Apr 13 21:41:03 user nova-compute[71325]:     <video supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='modelType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cirrus</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vmvga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>qxl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>none</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>bochs</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>ramfb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </video>
Apr 13 21:41:03 user nova-compute[71325]:     <hostdev supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='mode'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>subsystem</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='startupPolicy'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>default</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>mandatory</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>requisite</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>optional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='subsysType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pci</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='capsType'/>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='pciBackend'/>
Apr 13 21:41:03 user nova-compute[71325]:     </hostdev>
Apr 13 21:41:03 user nova-compute[71325]:     <rng supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>random</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egd</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>builtin</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </rng>
Apr 13 21:41:03 user nova-compute[71325]:     <filesystem supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='driverType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>path</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>handle</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtiofs</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </filesystem>
Apr 13 21:41:03 user nova-compute[71325]:     <tpm supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-tis</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-crb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>passthrough</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>emulator</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </tpm>
Apr 13 21:41:03 user nova-compute[71325]:   </devices>
Apr 13 21:41:03 user nova-compute[71325]:   <features>
Apr 13 21:41:03 user nova-compute[71325]:     <gic supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     <vmcoreinfo supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <genid supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backingStoreInput supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backup supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <sev supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:   </features>
Apr 13 21:41:03 user nova-compute[71325]: </domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:  {{(pid=71325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 13 21:41:03 user nova-compute[71325]: <domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 21:41:03 user nova-compute[71325]:   <domain>kvm</domain>
Apr 13 21:41:03 user nova-compute[71325]:   <machine>pc-q35-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:   <arch>x86_64</arch>
Apr 13 21:41:03 user nova-compute[71325]:   <vcpu max='288'/>
Apr 13 21:41:03 user nova-compute[71325]:   <iothreads supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:   <os supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='firmware'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>efi</value>
Apr 13 21:41:03 user nova-compute[71325]:     </enum>
Apr 13 21:41:03 user nova-compute[71325]:     <loader supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>rom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pflash</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='readonly'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>yes</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='secure'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>yes</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </loader>
Apr 13 21:41:03 user nova-compute[71325]:   </os>
Apr 13 21:41:03 user nova-compute[71325]:   <cpu>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-passthrough' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='hostPassthroughMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>on</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='maximum' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='maximumMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>on</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-model' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <vendor>Intel</vendor>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ss'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='vmx'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='pcid'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='hypervisor'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arat'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='umip'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='md-clear'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='invtsc'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibpb'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibrs'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='rsba'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='erms'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='custom' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>qemu64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>qemu32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>phenom</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>n270</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>kvm64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>kvm32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>coreduo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>core2duo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>athlon</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Westmere</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Snowridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Penryn</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G5</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G4</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Opteron_G1</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Nehalem</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Rome</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Milan</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Dhyana</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cooperlake</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Conroe</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>486</model>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:   </cpu>
Apr 13 21:41:03 user nova-compute[71325]:   <memoryBacking supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='sourceType'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>file</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>anonymous</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>memfd</value>
Apr 13 21:41:03 user nova-compute[71325]:     </enum>
Apr 13 21:41:03 user nova-compute[71325]:   </memoryBacking>
Apr 13 21:41:03 user nova-compute[71325]:   <devices>
Apr 13 21:41:03 user nova-compute[71325]:     <disk supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='diskDevice'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>disk</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cdrom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>floppy</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>lun</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='bus'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>fdc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sata</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </disk>
Apr 13 21:41:03 user nova-compute[71325]:     <graphics supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sdl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vnc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>spice</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egl-headless</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </graphics>
Apr 13 21:41:03 user nova-compute[71325]:     <video supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='modelType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cirrus</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vmvga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>qxl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>none</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>bochs</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>ramfb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </video>
Apr 13 21:41:03 user nova-compute[71325]:     <hostdev supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='mode'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>subsystem</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='startupPolicy'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>default</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>mandatory</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>requisite</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>optional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='subsysType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pci</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='capsType'/>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='pciBackend'/>
Apr 13 21:41:03 user nova-compute[71325]:     </hostdev>
Apr 13 21:41:03 user nova-compute[71325]:     <rng supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>random</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egd</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>builtin</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </rng>
Apr 13 21:41:03 user nova-compute[71325]:     <filesystem supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='driverType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>path</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>handle</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtiofs</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </filesystem>
Apr 13 21:41:03 user nova-compute[71325]:     <tpm supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-tis</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-crb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>passthrough</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>emulator</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </tpm>
Apr 13 21:41:03 user nova-compute[71325]:   </devices>
Apr 13 21:41:03 user nova-compute[71325]:   <features>
Apr 13 21:41:03 user nova-compute[71325]:     <gic supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     <vmcoreinfo supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <genid supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backingStoreInput supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backup supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <sev supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:   </features>
Apr 13 21:41:03 user nova-compute[71325]: </domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:  {{(pid=71325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 13 21:41:03 user nova-compute[71325]: <domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 21:41:03 user nova-compute[71325]:   <domain>kvm</domain>
Apr 13 21:41:03 user nova-compute[71325]:   <machine>pc-i440fx-jammy</machine>
Apr 13 21:41:03 user nova-compute[71325]:   <arch>x86_64</arch>
Apr 13 21:41:03 user nova-compute[71325]:   <vcpu max='255'/>
Apr 13 21:41:03 user nova-compute[71325]:   <iothreads supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:   <os supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='firmware'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>efi</value>
Apr 13 21:41:03 user nova-compute[71325]:     </enum>
Apr 13 21:41:03 user nova-compute[71325]:     <loader supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>rom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pflash</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='readonly'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>yes</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='secure'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </loader>
Apr 13 21:41:03 user nova-compute[71325]:   </os>
Apr 13 21:41:03 user nova-compute[71325]:   <cpu>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-passthrough' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='hostPassthroughMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>on</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='maximum' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='maximumMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>on</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-model' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <vendor>Intel</vendor>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ss'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='vmx'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='pcid'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='hypervisor'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arat'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='umip'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='md-clear'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='invtsc'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibpb'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibrs'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='rsba'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='erms'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='custom' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>qemu64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>qemu32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>phenom</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>n270</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>kvm64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>kvm32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>coreduo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>core2duo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>athlon</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Westmere</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Snowridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Penryn</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G5</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G4</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Opteron_G1</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Nehalem</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Rome</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Milan</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Dhyana</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cooperlake</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Conroe</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>486</model>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:   </cpu>
Apr 13 21:41:03 user nova-compute[71325]:   <memoryBacking supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='sourceType'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>file</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>anonymous</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>memfd</value>
Apr 13 21:41:03 user nova-compute[71325]:     </enum>
Apr 13 21:41:03 user nova-compute[71325]:   </memoryBacking>
Apr 13 21:41:03 user nova-compute[71325]:   <devices>
Apr 13 21:41:03 user nova-compute[71325]:     <disk supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='diskDevice'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>disk</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cdrom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>floppy</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>lun</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='bus'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>ide</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>fdc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sata</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </disk>
Apr 13 21:41:03 user nova-compute[71325]:     <graphics supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sdl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vnc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>spice</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egl-headless</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </graphics>
Apr 13 21:41:03 user nova-compute[71325]:     <video supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='modelType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cirrus</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vmvga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>qxl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>none</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>bochs</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>ramfb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </video>
Apr 13 21:41:03 user nova-compute[71325]:     <hostdev supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='mode'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>subsystem</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='startupPolicy'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>default</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>mandatory</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>requisite</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>optional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='subsysType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pci</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='capsType'/>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='pciBackend'/>
Apr 13 21:41:03 user nova-compute[71325]:     </hostdev>
Apr 13 21:41:03 user nova-compute[71325]:     <rng supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>random</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egd</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>builtin</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </rng>
Apr 13 21:41:03 user nova-compute[71325]:     <filesystem supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='driverType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>path</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>handle</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtiofs</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </filesystem>
Apr 13 21:41:03 user nova-compute[71325]:     <tpm supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-tis</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-crb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>passthrough</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>emulator</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </tpm>
Apr 13 21:41:03 user nova-compute[71325]:   </devices>
Apr 13 21:41:03 user nova-compute[71325]:   <features>
Apr 13 21:41:03 user nova-compute[71325]:     <gic supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     <vmcoreinfo supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <genid supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backingStoreInput supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backup supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <sev supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:   </features>
Apr 13 21:41:03 user nova-compute[71325]: </domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:  {{(pid=71325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 13 21:41:03 user nova-compute[71325]: <domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 21:41:03 user nova-compute[71325]:   <domain>kvm</domain>
Apr 13 21:41:03 user nova-compute[71325]:   <machine>pc-i440fx-6.2</machine>
Apr 13 21:41:03 user nova-compute[71325]:   <arch>x86_64</arch>
Apr 13 21:41:03 user nova-compute[71325]:   <vcpu max='255'/>
Apr 13 21:41:03 user nova-compute[71325]:   <iothreads supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:   <os supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='firmware'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>efi</value>
Apr 13 21:41:03 user nova-compute[71325]:     </enum>
Apr 13 21:41:03 user nova-compute[71325]:     <loader supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>rom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pflash</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='readonly'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>yes</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='secure'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </loader>
Apr 13 21:41:03 user nova-compute[71325]:   </os>
Apr 13 21:41:03 user nova-compute[71325]:   <cpu>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-passthrough' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='hostPassthroughMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>on</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='maximum' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='maximumMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>on</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-model' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <vendor>Intel</vendor>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ss'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='vmx'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='pcid'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='hypervisor'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arat'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='umip'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='md-clear'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='invtsc'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibpb'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibrs'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='rsba'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='erms'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='custom' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>qemu64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>qemu32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>phenom</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>n270</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>kvm64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>kvm32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>coreduo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>core2duo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>athlon</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Westmere</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Snowridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Penryn</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G5</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G4</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Opteron_G1</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Nehalem</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Rome</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Milan</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Dhyana</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cooperlake</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Conroe</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>486</model>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:   </cpu>
Apr 13 21:41:03 user nova-compute[71325]:   <memoryBacking supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='sourceType'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>file</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>anonymous</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>memfd</value>
Apr 13 21:41:03 user nova-compute[71325]:     </enum>
Apr 13 21:41:03 user nova-compute[71325]:   </memoryBacking>
Apr 13 21:41:03 user nova-compute[71325]:   <devices>
Apr 13 21:41:03 user nova-compute[71325]:     <disk supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='diskDevice'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>disk</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cdrom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>floppy</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>lun</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='bus'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>ide</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>fdc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sata</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </disk>
Apr 13 21:41:03 user nova-compute[71325]:     <graphics supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sdl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vnc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>spice</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egl-headless</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </graphics>
Apr 13 21:41:03 user nova-compute[71325]:     <video supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='modelType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cirrus</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vmvga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>qxl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>none</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>bochs</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>ramfb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </video>
Apr 13 21:41:03 user nova-compute[71325]:     <hostdev supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='mode'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>subsystem</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='startupPolicy'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>default</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>mandatory</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>requisite</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>optional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='subsysType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pci</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='capsType'/>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='pciBackend'/>
Apr 13 21:41:03 user nova-compute[71325]:     </hostdev>
Apr 13 21:41:03 user nova-compute[71325]:     <rng supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>random</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egd</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>builtin</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </rng>
Apr 13 21:41:03 user nova-compute[71325]:     <filesystem supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='driverType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>path</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>handle</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtiofs</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </filesystem>
Apr 13 21:41:03 user nova-compute[71325]:     <tpm supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-tis</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-crb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>passthrough</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>emulator</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </tpm>
Apr 13 21:41:03 user nova-compute[71325]:   </devices>
Apr 13 21:41:03 user nova-compute[71325]:   <features>
Apr 13 21:41:03 user nova-compute[71325]:     <gic supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     <vmcoreinfo supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <genid supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backingStoreInput supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backup supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <sev supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:   </features>
Apr 13 21:41:03 user nova-compute[71325]: </domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:  {{(pid=71325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 13 21:41:03 user nova-compute[71325]: <domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 21:41:03 user nova-compute[71325]:   <domain>kvm</domain>
Apr 13 21:41:03 user nova-compute[71325]:   <machine>pc-q35-jammy</machine>
Apr 13 21:41:03 user nova-compute[71325]:   <arch>x86_64</arch>
Apr 13 21:41:03 user nova-compute[71325]:   <vcpu max='288'/>
Apr 13 21:41:03 user nova-compute[71325]:   <iothreads supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:   <os supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='firmware'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>efi</value>
Apr 13 21:41:03 user nova-compute[71325]:     </enum>
Apr 13 21:41:03 user nova-compute[71325]:     <loader supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>rom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pflash</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='readonly'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>yes</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='secure'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>yes</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>no</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </loader>
Apr 13 21:41:03 user nova-compute[71325]:   </os>
Apr 13 21:41:03 user nova-compute[71325]:   <cpu>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-passthrough' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='hostPassthroughMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>on</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='maximum' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='maximumMigratable'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>on</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>off</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='host-model' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <vendor>Intel</vendor>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ss'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='vmx'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='pcid'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='hypervisor'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arat'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='umip'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='md-clear'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='invtsc'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibpb'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='ibrs'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-stibp'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='rsba'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='erms'/>
Apr 13 21:41:03 user nova-compute[71325]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:     <mode name='custom' supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>qemu64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>qemu32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>phenom</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>pentium</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>n270</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>kvm64</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>kvm32</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>coreduo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>core2duo</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>athlon</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Westmere</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Snowridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Skylake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>SandyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Penryn</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G5</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G4</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G3</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Opteron_G2</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Opteron_G1</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Nehalem</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>IvyBridge</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Icelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Haswell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Rome</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-Milan</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>EPYC</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Dhyana</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cooperlake</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>Conroe</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='no'>Broadwell</model>
Apr 13 21:41:03 user nova-compute[71325]:       <model usable='yes'>486</model>
Apr 13 21:41:03 user nova-compute[71325]:     </mode>
Apr 13 21:41:03 user nova-compute[71325]:   </cpu>
Apr 13 21:41:03 user nova-compute[71325]:   <memoryBacking supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:     <enum name='sourceType'>
Apr 13 21:41:03 user nova-compute[71325]:       <value>file</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>anonymous</value>
Apr 13 21:41:03 user nova-compute[71325]:       <value>memfd</value>
Apr 13 21:41:03 user nova-compute[71325]:     </enum>
Apr 13 21:41:03 user nova-compute[71325]:   </memoryBacking>
Apr 13 21:41:03 user nova-compute[71325]:   <devices>
Apr 13 21:41:03 user nova-compute[71325]:     <disk supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='diskDevice'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>disk</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cdrom</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>floppy</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>lun</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='bus'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>fdc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sata</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </disk>
Apr 13 21:41:03 user nova-compute[71325]:     <graphics supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='type'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>sdl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vnc</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>spice</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egl-headless</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </graphics>
Apr 13 21:41:03 user nova-compute[71325]:     <video supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='modelType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>cirrus</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>vmvga</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>qxl</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>none</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>bochs</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>ramfb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </video>
Apr 13 21:41:03 user nova-compute[71325]:     <hostdev supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='mode'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>subsystem</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='startupPolicy'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>default</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>mandatory</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>requisite</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>optional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='subsysType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>usb</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>pci</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>scsi</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='capsType'/>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='pciBackend'/>
Apr 13 21:41:03 user nova-compute[71325]:     </hostdev>
Apr 13 21:41:03 user nova-compute[71325]:     <rng supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtio-non-transitional</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>random</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>egd</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>builtin</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </rng>
Apr 13 21:41:03 user nova-compute[71325]:     <filesystem supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='driverType'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>path</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>handle</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>virtiofs</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </filesystem>
Apr 13 21:41:03 user nova-compute[71325]:     <tpm supported='yes'>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='model'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-tis</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>tpm-crb</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:       <enum name='backendModel'>
Apr 13 21:41:03 user nova-compute[71325]:         <value>passthrough</value>
Apr 13 21:41:03 user nova-compute[71325]:         <value>emulator</value>
Apr 13 21:41:03 user nova-compute[71325]:       </enum>
Apr 13 21:41:03 user nova-compute[71325]:     </tpm>
Apr 13 21:41:03 user nova-compute[71325]:   </devices>
Apr 13 21:41:03 user nova-compute[71325]:   <features>
Apr 13 21:41:03 user nova-compute[71325]:     <gic supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:     <vmcoreinfo supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <genid supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backingStoreInput supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <backup supported='yes'/>
Apr 13 21:41:03 user nova-compute[71325]:     <sev supported='no'/>
Apr 13 21:41:03 user nova-compute[71325]:   </features>
Apr 13 21:41:03 user nova-compute[71325]: </domainCapabilities>
Apr 13 21:41:03 user nova-compute[71325]:  {{(pid=71325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71325) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Checking secure boot support for host arch (x86_64) {{(pid=71325) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 13 21:41:03 user nova-compute[71325]: INFO nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Secure Boot support detected
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] cpu compare xml: <cpu match="exact">
Apr 13 21:41:03 user nova-compute[71325]:   <model>Nehalem</model>
Apr 13 21:41:03 user nova-compute[71325]: </cpu>
Apr 13 21:41:03 user nova-compute[71325]:  {{(pid=71325) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 13 21:41:03 user nova-compute[71325]: INFO nova.virt.node [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Generated node identity 2eb44a42-41ff-4980-ae1c-f21099638e55
Apr 13 21:41:03 user nova-compute[71325]: INFO nova.virt.node [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Wrote node identity 2eb44a42-41ff-4980-ae1c-f21099638e55 to /opt/stack/data/nova/compute_id
Apr 13 21:41:03 user nova-compute[71325]: WARNING nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Compute nodes ['2eb44a42-41ff-4980-ae1c-f21099638e55'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 13 21:41:03 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 13 21:41:03 user nova-compute[71325]: WARNING nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 13 21:41:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:41:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:41:04 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:41:04 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Hypervisor/Node resource view: name=user free_ram=10829MB free_disk=27.080379486083984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:41:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:41:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:41:04 user nova-compute[71325]: WARNING nova.compute.resource_tracker [None req-407220e4-cb14-404b-9e23-150615938b70 None None] No compute node record for user:2eb44a42-41ff-4980-ae1c-f21099638e55: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 2eb44a42-41ff-4980-ae1c-f21099638e55 could not be found.
Apr 13 21:41:04 user nova-compute[71325]: INFO nova.compute.resource_tracker [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Compute node record created for user:user with uuid: 2eb44a42-41ff-4980-ae1c-f21099638e55
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:41:04 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [req-8c65f2a0-17cb-444e-8049-0a326ba61246] Created resource provider record via placement API for resource provider with UUID 2eb44a42-41ff-4980-ae1c-f21099638e55 and name user.
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71325) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 13 21:41:04 user nova-compute[71325]: INFO nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] kernel doesn't support AMD SEV
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Updating inventory in ProviderTree for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Libvirt baseline CPU <cpu>
Apr 13 21:41:04 user nova-compute[71325]:   <arch>x86_64</arch>
Apr 13 21:41:04 user nova-compute[71325]:   <model>Nehalem</model>
Apr 13 21:41:04 user nova-compute[71325]:   <vendor>Intel</vendor>
Apr 13 21:41:04 user nova-compute[71325]:   <topology sockets="6" cores="1" threads="1"/>
Apr 13 21:41:04 user nova-compute[71325]: </cpu>
Apr 13 21:41:04 user nova-compute[71325]:  {{(pid=71325) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Updated inventory for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Updating resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55 generation from 0 to 1 during operation: update_inventory {{(pid=71325) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Updating inventory in ProviderTree for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Updating resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55 generation from 1 to 2 during operation: update_traits {{(pid=71325) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:41:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.service [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Creating RPC server for service compute {{(pid=71325) start /opt/stack/nova/nova/service.py:182}}
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.service [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Join ServiceGroup membership for this service compute {{(pid=71325) start /opt/stack/nova/nova/service.py:199}}
Apr 13 21:41:04 user nova-compute[71325]: DEBUG nova.servicegroup.drivers.db [None req-407220e4-cb14-404b-9e23-150615938b70 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71325) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 13 21:41:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:41:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:41:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:41:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 21:41:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Didn't find any instances for network info cache update. {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 21:41:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:41:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:41:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:41:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:41:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:41:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:41:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:41:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:41:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:41:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:41:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:41:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:41:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:41:56 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:41:56 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:41:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=10168MB free_disk=26.994171142578125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:41:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:41:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:41:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:41:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:41:56 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:41:56 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:41:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:41:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:41:56 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Didn't find any instances for network info cache update. {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:42:56 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:42:56 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:42:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=10171MB free_disk=27.041645050048828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:42:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:42:57 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:42:57 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:42:57 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:42:57 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:42:57 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:42:57 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:43:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:43:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:43:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 21:43:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Didn't find any instances for network info cache update. {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 21:43:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:43:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:43:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:43:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:43:55 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:43:55 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:43:55 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:43:55 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=10171MB free_disk=26.818679809570312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:43:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:43:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:43:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:43:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:43:56 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:43:56 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:43:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:43:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:43:57 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:43:57 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:43:57 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:43:57 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:43:57 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:43:58 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:43:59 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:43:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:44:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:44:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:44:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:44:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:44:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:44:55 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:44:56 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:44:56 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:44:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=9440MB free_disk=26.847946166992188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:44:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:44:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:44:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:44:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:44:56 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:44:56 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:44:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:44:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:44:57 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:44:57 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:44:57 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:44:57 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 21:44:57 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Didn't find any instances for network info cache update. {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 21:44:58 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:44:58 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:44:58 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:44:58 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:44:59 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:45:00 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:45:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:45:08 user nova-compute[71325]: INFO nova.compute.claims [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Claim successful on node user
Apr 13 21:45:08 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.289s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:08 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:45:08 user nova-compute[71325]: INFO nova.compute.claims [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Claim successful on node user
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.network.neutron [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:45:09 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:45:09 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Creating image(s)
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "/opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "/opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "/opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.network.neutron [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:45:09 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9.part --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:45:09 user nova-compute[71325]: INFO nova.compute.claims [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Claim successful on node user
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:45:09 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Creating image(s)
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "/opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "/opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "/opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9.part --force-share --output=json" returned: 0 in 0.164s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.virt.images [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] f414347d-1c32-419c-89fc-b23b61a6c286 was qcow2, converting to raw {{(pid=71325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:45:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9.part /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9.converted {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG nova.policy [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG nova.policy [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02a7fc7a42b441cfa3c6bc04f4dd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1071d640fb44ff9966fab7888668ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9.part /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9.converted" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9.converted --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "68cb788e-be1f-44fc-b65e-b908a5831ae2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9.converted --force-share --output=json" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.928s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:10 user nova-compute[71325]: INFO oslo.privsep.daemon [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp77pbraqk/privsep.sock']
Apr 13 21:45:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.386s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:45:10 user sudo[80060]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp77pbraqk/privsep.sock
Apr 13 21:45:10 user sudo[80060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 21:45:10 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:45:10 user nova-compute[71325]: INFO nova.compute.claims [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Claim successful on node user
Apr 13 21:45:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG nova.network.neutron [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:45:10 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:45:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG nova.policy [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:45:10 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Creating image(s)
Apr 13 21:45:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "/opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "/opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:11 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:45:11 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:45:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:45:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:45:11 user nova-compute[71325]: DEBUG nova.network.neutron [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:45:11 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:45:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:45:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:45:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:45:11 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Creating image(s)
Apr 13 21:45:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "/opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "/opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "/opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:11 user nova-compute[71325]: DEBUG nova.policy [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:45:12 user sudo[80060]: pam_unix(sudo:session): session closed for user root
Apr 13 21:45:12 user nova-compute[71325]: INFO oslo.privsep.daemon [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Spawned new privsep daemon via rootwrap
Apr 13 21:45:12 user nova-compute[71325]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 21:45:12 user nova-compute[71325]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 21:45:12 user nova-compute[71325]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 13 21:45:12 user nova-compute[71325]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80065
Apr 13 21:45:12 user nova-compute[71325]: WARNING oslo_privsep.priv_context [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] privsep daemon already running
Apr 13 21:45:12 user nova-compute[71325]: WARNING oslo_privsep.priv_context [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] privsep daemon already running
Apr 13 21:45:12 user nova-compute[71325]: WARNING oslo_privsep.priv_context [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] privsep daemon already running
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.164s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.120s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk 1073741824" returned: 0 in 0.046s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.142s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.151s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk 1073741824" returned: 0 in 0.044s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.354s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Cannot resize image /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG nova.objects.instance [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'migration_context' on Instance uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Ensure instance console log exists: /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:45:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.178s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk 1073741824" returned: 0 in 0.074s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.633s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Cannot resize image /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.objects.instance [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'migration_context' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Ensure instance console log exists: /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk 1073741824" returned: 0 in 0.050s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.network.neutron [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Successfully created port: a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Cannot resize image /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.objects.instance [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'migration_context' on Instance uuid 68cb788e-be1f-44fc-b65e-b908a5831ae2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Ensure instance console log exists: /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Cannot resize image /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.objects.instance [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lazy-loading 'migration_context' on Instance uuid 8645ede7-1e10-4520-8092-6cc6dfc3d82a {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Ensure instance console log exists: /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:13 user nova-compute[71325]: DEBUG nova.network.neutron [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Successfully created port: fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:45:14 user nova-compute[71325]: DEBUG nova.network.neutron [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Successfully created port: ba4d973f-18b3-4b49-b663-627155851ce8 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:45:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "3a8e8627-03d4-4a17-a324-93def1017101" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "3a8e8627-03d4-4a17-a324-93def1017101" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:45:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:14 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:45:14 user nova-compute[71325]: INFO nova.compute.claims [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Claim successful on node user
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Successfully created port: b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:45:15 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Successfully updated port: a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:45:15 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Creating image(s)
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "/opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "/opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquired lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.policy [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7299dc5fc1ad4f3eb769eda4dac5abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aed26c3fb143cab8c3c1599f70d858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.167s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk 1073741824" returned: 0 in 0.045s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-changed-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Refreshing instance network info cache due to event network-changed-a70898ac-83fd-4f25-be37-aef7c87f6059. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] Acquiring lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:45:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:16 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Cannot resize image /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:45:16 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lazy-loading 'migration_context' on Instance uuid 3a8e8627-03d4-4a17-a324-93def1017101 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:45:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Ensure instance console log exists: /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:45:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.network.neutron [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Updating instance_info_cache with network_info: [{"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Releasing lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Instance network_info: |[{"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] Acquired lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.network.neutron [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Refreshing network info cache for port a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Start _get_guest_xml network_info=[{"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:17 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:17 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-140399517',display_name='tempest-AttachVolumeTestJSON-server-140399517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-140399517',id=3,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtoB3nR0JKHa6Ky1vXPwyI7w+rB3Ypa07sW6QVuaj3CXiFeuqRSmd55pQSr/lvFo9l5efcEiAn2oFJFeJlQXi0+ollyvkUFol9Z6nrTwTO2rVl/RiddJVHfv6WKf61UrQ==',key_name='tempest-keypair-789187285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3605d609b52b431993bcea0798a77554',ramdisk_id='',reservation_id='r-gimed3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-249879422',owner_user_name='tempest-AttachVolumeTestJSON-249879422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60e4dadf9d9e41e6a91ee03a0cd50dc3',uuid=ddc7aa71-95a1-4a3c-a5c1-746b86a011c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converting VIF {"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.objects.instance [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'pci_devices' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:45:17 user nova-compute[71325]:   <uuid>ddc7aa71-95a1-4a3c-a5c1-746b86a011c2</uuid>
Apr 13 21:45:17 user nova-compute[71325]:   <name>instance-00000003</name>
Apr 13 21:45:17 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:45:17 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:45:17 user nova-compute[71325]:   <metadata>
Apr 13 21:45:17 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:45:17 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:45:17 user nova-compute[71325]:       <nova:name>tempest-AttachVolumeTestJSON-server-140399517</nova:name>
Apr 13 21:45:17 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:45:17</nova:creationTime>
Apr 13 21:45:17 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:45:17 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:45:17 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:45:17 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:45:17 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:45:17 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:45:17 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:45:17 user nova-compute[71325]:       <nova:owner>
Apr 13 21:45:17 user nova-compute[71325]:         <nova:user uuid="60e4dadf9d9e41e6a91ee03a0cd50dc3">tempest-AttachVolumeTestJSON-249879422-project-member</nova:user>
Apr 13 21:45:17 user nova-compute[71325]:         <nova:project uuid="3605d609b52b431993bcea0798a77554">tempest-AttachVolumeTestJSON-249879422</nova:project>
Apr 13 21:45:17 user nova-compute[71325]:       </nova:owner>
Apr 13 21:45:17 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:45:17 user nova-compute[71325]:       <nova:ports>
Apr 13 21:45:17 user nova-compute[71325]:         <nova:port uuid="a70898ac-83fd-4f25-be37-aef7c87f6059">
Apr 13 21:45:17 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 21:45:17 user nova-compute[71325]:         </nova:port>
Apr 13 21:45:17 user nova-compute[71325]:       </nova:ports>
Apr 13 21:45:17 user nova-compute[71325]:     </nova:instance>
Apr 13 21:45:17 user nova-compute[71325]:   </metadata>
Apr 13 21:45:17 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:45:17 user nova-compute[71325]:     <system>
Apr 13 21:45:17 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:45:17 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:45:17 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:45:17 user nova-compute[71325]:       <entry name="serial">ddc7aa71-95a1-4a3c-a5c1-746b86a011c2</entry>
Apr 13 21:45:17 user nova-compute[71325]:       <entry name="uuid">ddc7aa71-95a1-4a3c-a5c1-746b86a011c2</entry>
Apr 13 21:45:17 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:45:17 user nova-compute[71325]:     </system>
Apr 13 21:45:17 user nova-compute[71325]:   </sysinfo>
Apr 13 21:45:17 user nova-compute[71325]:   <os>
Apr 13 21:45:17 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:45:17 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:45:17 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:45:17 user nova-compute[71325]:   </os>
Apr 13 21:45:17 user nova-compute[71325]:   <features>
Apr 13 21:45:17 user nova-compute[71325]:     <acpi/>
Apr 13 21:45:17 user nova-compute[71325]:     <apic/>
Apr 13 21:45:17 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:45:17 user nova-compute[71325]:   </features>
Apr 13 21:45:17 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:45:17 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:45:17 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:45:17 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:45:17 user nova-compute[71325]:   </clock>
Apr 13 21:45:17 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:45:17 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:45:17 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:45:17 user nova-compute[71325]:   </cpu>
Apr 13 21:45:17 user nova-compute[71325]:   <devices>
Apr 13 21:45:17 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:45:17 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:45:17 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk"/>
Apr 13 21:45:17 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:45:17 user nova-compute[71325]:     </disk>
Apr 13 21:45:17 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:45:17 user nova-compute[71325]:       <mac address="fa:16:3e:fd:52:e7"/>
Apr 13 21:45:17 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:17 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:45:17 user nova-compute[71325]:       <target dev="tapa70898ac-83"/>
Apr 13 21:45:17 user nova-compute[71325]:     </interface>
Apr 13 21:45:17 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:45:17 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/console.log" append="off"/>
Apr 13 21:45:17 user nova-compute[71325]:     </serial>
Apr 13 21:45:17 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:45:17 user nova-compute[71325]:     <video>
Apr 13 21:45:17 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:17 user nova-compute[71325]:     </video>
Apr 13 21:45:17 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:45:17 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:45:17 user nova-compute[71325]:     </rng>
Apr 13 21:45:17 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:45:17 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:45:17 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:45:17 user nova-compute[71325]:     </memballoon>
Apr 13 21:45:17 user nova-compute[71325]:   </devices>
Apr 13 21:45:17 user nova-compute[71325]: </domain>
Apr 13 21:45:17 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-140399517',display_name='tempest-AttachVolumeTestJSON-server-140399517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-140399517',id=3,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtoB3nR0JKHa6Ky1vXPwyI7w+rB3Ypa07sW6QVuaj3CXiFeuqRSmd55pQSr/lvFo9l5efcEiAn2oFJFeJlQXi0+ollyvkUFol9Z6nrTwTO2rVl/RiddJVHfv6WKf61UrQ==',key_name='tempest-keypair-789187285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3605d609b52b431993bcea0798a77554',ramdisk_id='',reservation_id='r-gimed3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-249879422',owner_user_name='tempest-AttachVolumeTestJSON-249879422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60e4dadf9d9e41e6a91ee03a0cd50dc3',uuid=ddc7aa71-95a1-4a3c-a5c1-746b86a011c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converting VIF {"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG os_vif [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Created schema index Interface.name {{(pid=71325) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Created schema index Port.name {{(pid=71325) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Created schema index Bridge.name {{(pid=71325) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [POLLOUT] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:45:17 user nova-compute[71325]: INFO oslo.privsep.daemon [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpn36m5jqh/privsep.sock']
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:45:17 user nova-compute[71325]: INFO nova.compute.claims [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Claim successful on node user
Apr 13 21:45:17 user sudo[80151]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpn36m5jqh/privsep.sock
Apr 13 21:45:17 user sudo[80151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.network.neutron [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Successfully updated port: fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquired lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.network.neutron [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.network.neutron [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Successfully updated port: ba4d973f-18b3-4b49-b663-627155851ce8 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "refresh_cache-8645ede7-1e10-4520-8092-6cc6dfc3d82a" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquired lock "refresh_cache-8645ede7-1e10-4520-8092-6cc6dfc3d82a" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.network.neutron [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.network.neutron [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.network.neutron [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.network.neutron [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:45:17 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-changed-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Refreshing instance network info cache due to event network-changed-fdc6b9f2-62b6-44df-a2e4-e923e1e57964. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] Acquiring lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:45:18 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Creating image(s)
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "/opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "/opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "/opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.policy [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.133s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk 1073741824" returned: 0 in 0.055s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Successfully updated port: b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquired lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Cannot resize image /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.objects.instance [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'migration_context' on Instance uuid eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.network.neutron [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Updated VIF entry in instance network info cache for port a70898ac-83fd-4f25-be37-aef7c87f6059. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.network.neutron [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Updating instance_info_cache with network_info: [{"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Ensure instance console log exists: /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] Releasing lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-b4f2a2ea-29dc-4c8c-aecb-0306881d9d16 req-56ee7bfb-2694-4580-9860-8b343ee5729f service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received event network-changed-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-b4f2a2ea-29dc-4c8c-aecb-0306881d9d16 req-56ee7bfb-2694-4580-9860-8b343ee5729f service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Refreshing instance network info cache due to event network-changed-b4a7d649-3cf1-4452-9f1d-430f0ce841ca. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b4f2a2ea-29dc-4c8c-aecb-0306881d9d16 req-56ee7bfb-2694-4580-9860-8b343ee5729f service nova] Acquiring lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Successfully created port: a9262ff5-d93b-430d-839d-39cdfccb47c4 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Updating instance_info_cache with network_info: [{"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Updating instance_info_cache with network_info: [{"id": "ba4d973f-18b3-4b49-b663-627155851ce8", "address": "fa:16:3e:36:cc:b4", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4d973f-18", "ovs_interfaceid": "ba4d973f-18b3-4b49-b663-627155851ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Releasing lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG nova.compute.manager [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Instance network_info: |[{"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:45:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] Acquired lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.network.neutron [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Refreshing network info cache for port fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Start _get_guest_xml network_info=[{"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Releasing lock "refresh_cache-8645ede7-1e10-4520-8092-6cc6dfc3d82a" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Instance network_info: |[{"id": "ba4d973f-18b3-4b49-b663-627155851ce8", "address": "fa:16:3e:36:cc:b4", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4d973f-18", "ovs_interfaceid": "ba4d973f-18b3-4b49-b663-627155851ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Start _get_guest_xml network_info=[{"id": "ba4d973f-18b3-4b49-b663-627155851ce8", "address": "fa:16:3e:36:cc:b4", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4d973f-18", "ovs_interfaceid": "ba4d973f-18b3-4b49-b663-627155851ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:45:19 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:19 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-579437522',display_name='tempest-ServerRescueNegativeTestJSON-server-579437522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-579437522',id=1,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70e84a09a76a44eb830e575db4321224',ramdisk_id='',reservation_id='r-pepi5puo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-546430736',owner_user_name='tempest-ServerRescueNegativeTestJSON-546430736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:09Z,user_data=None,user_id='e77459bc3fa8496da1a089c460e32ed2',uuid=f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converting VIF {"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:c1:d3,bridge_name='br-int',has_traffic_filtering=True,id=fdc6b9f2-62b6-44df-a2e4-e923e1e57964,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc6b9f2-62') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'pci_devices' on Instance uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:19 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:19 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2106730690',display_name='tempest-ServersNegativeTestJSON-server-2106730690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2106730690',id=2,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1071d640fb44ff9966fab7888668ed5',ramdisk_id='',reservation_id='r-7xnr3wkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1571285098',owner_user_name='tempest-ServersNegativeTestJSON-1571285098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:10Z,user_data=None,user_id='02a7fc7a42b441cfa3c6bc04f4dd6cb9',uuid=8645ede7-1e10-4520-8092-6cc6dfc3d82a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4d973f-18b3-4b49-b663-627155851ce8", "address": "fa:16:3e:36:cc:b4", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4d973f-18", "ovs_interfaceid": "ba4d973f-18b3-4b49-b663-627155851ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Converting VIF {"id": "ba4d973f-18b3-4b49-b663-627155851ce8", "address": "fa:16:3e:36:cc:b4", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4d973f-18", "ovs_interfaceid": "ba4d973f-18b3-4b49-b663-627155851ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:cc:b4,bridge_name='br-int',has_traffic_filtering=True,id=ba4d973f-18b3-4b49-b663-627155851ce8,network=Network(ed9169cc-af6d-4d31-9b2e-9016c5f963c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4d973f-18') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lazy-loading 'pci_devices' on Instance uuid 8645ede7-1e10-4520-8092-6cc6dfc3d82a {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:45:19 user nova-compute[71325]:   <uuid>f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de</uuid>
Apr 13 21:45:19 user nova-compute[71325]:   <name>instance-00000001</name>
Apr 13 21:45:19 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:45:19 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:45:19 user nova-compute[71325]:   <metadata>
Apr 13 21:45:19 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:45:19 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:45:19 user nova-compute[71325]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-579437522</nova:name>
Apr 13 21:45:19 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:45:19</nova:creationTime>
Apr 13 21:45:19 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:45:19 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:45:19 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:45:19 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:45:19 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:45:19 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:45:19 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:45:19 user nova-compute[71325]:       <nova:owner>
Apr 13 21:45:19 user nova-compute[71325]:         <nova:user uuid="e77459bc3fa8496da1a089c460e32ed2">tempest-ServerRescueNegativeTestJSON-546430736-project-member</nova:user>
Apr 13 21:45:19 user nova-compute[71325]:         <nova:project uuid="70e84a09a76a44eb830e575db4321224">tempest-ServerRescueNegativeTestJSON-546430736</nova:project>
Apr 13 21:45:19 user nova-compute[71325]:       </nova:owner>
Apr 13 21:45:19 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:45:19 user nova-compute[71325]:       <nova:ports>
Apr 13 21:45:19 user nova-compute[71325]:         <nova:port uuid="fdc6b9f2-62b6-44df-a2e4-e923e1e57964">
Apr 13 21:45:19 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 21:45:19 user nova-compute[71325]:         </nova:port>
Apr 13 21:45:19 user nova-compute[71325]:       </nova:ports>
Apr 13 21:45:19 user nova-compute[71325]:     </nova:instance>
Apr 13 21:45:19 user nova-compute[71325]:   </metadata>
Apr 13 21:45:19 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:45:19 user nova-compute[71325]:     <system>
Apr 13 21:45:19 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:45:19 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:45:19 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:45:19 user nova-compute[71325]:       <entry name="serial">f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de</entry>
Apr 13 21:45:19 user nova-compute[71325]:       <entry name="uuid">f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de</entry>
Apr 13 21:45:19 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:45:19 user nova-compute[71325]:     </system>
Apr 13 21:45:19 user nova-compute[71325]:   </sysinfo>
Apr 13 21:45:19 user nova-compute[71325]:   <os>
Apr 13 21:45:19 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:45:19 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:45:19 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:45:19 user nova-compute[71325]:   </os>
Apr 13 21:45:19 user nova-compute[71325]:   <features>
Apr 13 21:45:19 user nova-compute[71325]:     <acpi/>
Apr 13 21:45:19 user nova-compute[71325]:     <apic/>
Apr 13 21:45:19 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:45:19 user nova-compute[71325]:   </features>
Apr 13 21:45:19 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:45:19 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:45:19 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:45:19 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:45:19 user nova-compute[71325]:   </clock>
Apr 13 21:45:19 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:45:19 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:45:19 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:45:19 user nova-compute[71325]:   </cpu>
Apr 13 21:45:19 user nova-compute[71325]:   <devices>
Apr 13 21:45:19 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:45:19 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:45:19 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk"/>
Apr 13 21:45:19 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:45:19 user nova-compute[71325]:     </disk>
Apr 13 21:45:19 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:45:19 user nova-compute[71325]:       <mac address="fa:16:3e:40:c1:d3"/>
Apr 13 21:45:19 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:19 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:45:19 user nova-compute[71325]:       <target dev="tapfdc6b9f2-62"/>
Apr 13 21:45:19 user nova-compute[71325]:     </interface>
Apr 13 21:45:19 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:45:19 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/console.log" append="off"/>
Apr 13 21:45:19 user nova-compute[71325]:     </serial>
Apr 13 21:45:19 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:45:19 user nova-compute[71325]:     <video>
Apr 13 21:45:19 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:19 user nova-compute[71325]:     </video>
Apr 13 21:45:19 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:45:19 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:45:19 user nova-compute[71325]:     </rng>
Apr 13 21:45:19 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:45:19 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:45:19 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:45:19 user nova-compute[71325]:     </memballoon>
Apr 13 21:45:19 user nova-compute[71325]:   </devices>
Apr 13 21:45:19 user nova-compute[71325]: </domain>
Apr 13 21:45:19 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-579437522',display_name='tempest-ServerRescueNegativeTestJSON-server-579437522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-579437522',id=1,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70e84a09a76a44eb830e575db4321224',ramdisk_id='',reservation_id='r-pepi5puo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-546430736',owner_user_name='tempest-ServerRescueNegativeTestJSON-546430736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:09Z,user_data=None,user_id='e77459bc3fa8496da1a089c460e32ed2',uuid=f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converting VIF {"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:c1:d3,bridge_name='br-int',has_traffic_filtering=True,id=fdc6b9f2-62b6-44df-a2e4-e923e1e57964,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc6b9f2-62') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG os_vif [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:c1:d3,bridge_name='br-int',has_traffic_filtering=True,id=fdc6b9f2-62b6-44df-a2e4-e923e1e57964,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc6b9f2-62') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:45:19 user nova-compute[71325]:   <uuid>8645ede7-1e10-4520-8092-6cc6dfc3d82a</uuid>
Apr 13 21:45:19 user nova-compute[71325]:   <name>instance-00000002</name>
Apr 13 21:45:19 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:45:19 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:45:19 user nova-compute[71325]:   <metadata>
Apr 13 21:45:19 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:45:19 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:45:19 user nova-compute[71325]:       <nova:name>tempest-ServersNegativeTestJSON-server-2106730690</nova:name>
Apr 13 21:45:19 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:45:19</nova:creationTime>
Apr 13 21:45:19 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:45:19 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:45:19 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:45:19 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:45:19 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:45:19 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:45:19 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:45:19 user nova-compute[71325]:       <nova:owner>
Apr 13 21:45:19 user nova-compute[71325]:         <nova:user uuid="02a7fc7a42b441cfa3c6bc04f4dd6cb9">tempest-ServersNegativeTestJSON-1571285098-project-member</nova:user>
Apr 13 21:45:19 user nova-compute[71325]:         <nova:project uuid="f1071d640fb44ff9966fab7888668ed5">tempest-ServersNegativeTestJSON-1571285098</nova:project>
Apr 13 21:45:19 user nova-compute[71325]:       </nova:owner>
Apr 13 21:45:19 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:45:19 user nova-compute[71325]:       <nova:ports>
Apr 13 21:45:19 user nova-compute[71325]:         <nova:port uuid="ba4d973f-18b3-4b49-b663-627155851ce8">
Apr 13 21:45:19 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 21:45:19 user nova-compute[71325]:         </nova:port>
Apr 13 21:45:19 user nova-compute[71325]:       </nova:ports>
Apr 13 21:45:19 user nova-compute[71325]:     </nova:instance>
Apr 13 21:45:19 user nova-compute[71325]:   </metadata>
Apr 13 21:45:19 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:45:19 user nova-compute[71325]:     <system>
Apr 13 21:45:19 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:45:19 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:45:19 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:45:19 user nova-compute[71325]:       <entry name="serial">8645ede7-1e10-4520-8092-6cc6dfc3d82a</entry>
Apr 13 21:45:19 user nova-compute[71325]:       <entry name="uuid">8645ede7-1e10-4520-8092-6cc6dfc3d82a</entry>
Apr 13 21:45:19 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:45:19 user nova-compute[71325]:     </system>
Apr 13 21:45:19 user nova-compute[71325]:   </sysinfo>
Apr 13 21:45:19 user nova-compute[71325]:   <os>
Apr 13 21:45:19 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:45:19 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:45:19 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:45:19 user nova-compute[71325]:   </os>
Apr 13 21:45:19 user nova-compute[71325]:   <features>
Apr 13 21:45:19 user nova-compute[71325]:     <acpi/>
Apr 13 21:45:19 user nova-compute[71325]:     <apic/>
Apr 13 21:45:19 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:45:19 user nova-compute[71325]:   </features>
Apr 13 21:45:19 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:45:19 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:45:19 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:45:19 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:45:19 user nova-compute[71325]:   </clock>
Apr 13 21:45:19 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:45:19 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:45:19 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:45:19 user nova-compute[71325]:   </cpu>
Apr 13 21:45:19 user nova-compute[71325]:   <devices>
Apr 13 21:45:19 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:45:19 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:45:19 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk"/>
Apr 13 21:45:19 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:45:19 user nova-compute[71325]:     </disk>
Apr 13 21:45:19 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:45:19 user nova-compute[71325]:       <mac address="fa:16:3e:36:cc:b4"/>
Apr 13 21:45:19 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:19 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:45:19 user nova-compute[71325]:       <target dev="tapba4d973f-18"/>
Apr 13 21:45:19 user nova-compute[71325]:     </interface>
Apr 13 21:45:19 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:45:19 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/console.log" append="off"/>
Apr 13 21:45:19 user nova-compute[71325]:     </serial>
Apr 13 21:45:19 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:45:19 user nova-compute[71325]:     <video>
Apr 13 21:45:19 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:19 user nova-compute[71325]:     </video>
Apr 13 21:45:19 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:45:19 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:45:19 user nova-compute[71325]:     </rng>
Apr 13 21:45:19 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:45:19 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:45:19 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:45:19 user nova-compute[71325]:     </memballoon>
Apr 13 21:45:19 user nova-compute[71325]:   </devices>
Apr 13 21:45:19 user nova-compute[71325]: </domain>
Apr 13 21:45:19 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2106730690',display_name='tempest-ServersNegativeTestJSON-server-2106730690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2106730690',id=2,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1071d640fb44ff9966fab7888668ed5',ramdisk_id='',reservation_id='r-7xnr3wkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1571285098',owner_user_name='tempest-ServersNegativeTestJSON-1571285098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:10Z,user_data=None,user_id='02a7fc7a42b441cfa3c6bc04f4dd6cb9',uuid=8645ede7-1e10-4520-8092-6cc6dfc3d82a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4d973f-18b3-4b49-b663-627155851ce8", "address": "fa:16:3e:36:cc:b4", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4d973f-18", "ovs_interfaceid": "ba4d973f-18b3-4b49-b663-627155851ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Converting VIF {"id": "ba4d973f-18b3-4b49-b663-627155851ce8", "address": "fa:16:3e:36:cc:b4", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4d973f-18", "ovs_interfaceid": "ba4d973f-18b3-4b49-b663-627155851ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:cc:b4,bridge_name='br-int',has_traffic_filtering=True,id=ba4d973f-18b3-4b49-b663-627155851ce8,network=Network(ed9169cc-af6d-4d31-9b2e-9016c5f963c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4d973f-18') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG os_vif [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:cc:b4,bridge_name='br-int',has_traffic_filtering=True,id=ba4d973f-18b3-4b49-b663-627155851ce8,network=Network(ed9169cc-af6d-4d31-9b2e-9016c5f963c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4d973f-18') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:45:19 user sudo[80151]: pam_unix(sudo:session): session closed for user root
Apr 13 21:45:19 user nova-compute[71325]: INFO oslo.privsep.daemon [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Spawned new privsep daemon via rootwrap
Apr 13 21:45:19 user nova-compute[71325]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 21:45:19 user nova-compute[71325]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 21:45:19 user nova-compute[71325]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 13 21:45:19 user nova-compute[71325]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80169
Apr 13 21:45:19 user nova-compute[71325]: WARNING oslo_privsep.priv_context [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] privsep daemon already running
Apr 13 21:45:19 user nova-compute[71325]: WARNING oslo_privsep.priv_context [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] privsep daemon already running
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:45:19 user nova-compute[71325]: INFO nova.compute.claims [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Claim successful on node user
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba4d973f-18, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba4d973f-18, col_values=(('external_ids', {'iface-id': 'ba4d973f-18b3-4b49-b663-627155851ce8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:cc:b4', 'vm-uuid': '8645ede7-1e10-4520-8092-6cc6dfc3d82a'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:19 user nova-compute[71325]: INFO os_vif [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:cc:b4,bridge_name='br-int',has_traffic_filtering=True,id=ba4d973f-18b3-4b49-b663-627155851ce8,network=Network(ed9169cc-af6d-4d31-9b2e-9016c5f963c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4d973f-18')
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdc6b9f2-62, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfdc6b9f2-62, col_values=(('external_ids', {'iface-id': 'fdc6b9f2-62b6-44df-a2e4-e923e1e57964', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:c1:d3', 'vm-uuid': 'f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:19 user nova-compute[71325]: INFO os_vif [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:c1:d3,bridge_name='br-int',has_traffic_filtering=True,id=fdc6b9f2-62b6-44df-a2e4-e923e1e57964,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc6b9f2-62')
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa70898ac-83, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa70898ac-83, col_values=(('external_ids', {'iface-id': 'a70898ac-83fd-4f25-be37-aef7c87f6059', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:52:e7', 'vm-uuid': 'ddc7aa71-95a1-4a3c-a5c1-746b86a011c2'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:19 user nova-compute[71325]: INFO os_vif [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83')
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] No VIF found with MAC fa:16:3e:36:cc:b4, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No VIF found with MAC fa:16:3e:40:c1:d3, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] No VIF found with MAC fa:16:3e:fd:52:e7, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.network.neutron [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Updated VIF entry in instance network info cache for port fdc6b9f2-62b6-44df-a2e4-e923e1e57964. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.network.neutron [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Updating instance_info_cache with network_info: [{"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] Releasing lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.network.neutron [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Successfully created port: e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.network.neutron [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-ec96c0d1-6c60-4782-a878-a149fcff4b25 req-ed57295c-806f-413e-b138-0901441d5055 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Received event network-changed-ba4d973f-18b3-4b49-b663-627155851ce8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-ec96c0d1-6c60-4782-a878-a149fcff4b25 req-ed57295c-806f-413e-b138-0901441d5055 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Refreshing instance network info cache due to event network-changed-ba4d973f-18b3-4b49-b663-627155851ce8. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ec96c0d1-6c60-4782-a878-a149fcff4b25 req-ed57295c-806f-413e-b138-0901441d5055 service nova] Acquiring lock "refresh_cache-8645ede7-1e10-4520-8092-6cc6dfc3d82a" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ec96c0d1-6c60-4782-a878-a149fcff4b25 req-ed57295c-806f-413e-b138-0901441d5055 service nova] Acquired lock "refresh_cache-8645ede7-1e10-4520-8092-6cc6dfc3d82a" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.network.neutron [req-ec96c0d1-6c60-4782-a878-a149fcff4b25 req-ed57295c-806f-413e-b138-0901441d5055 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Refreshing network info cache for port ba4d973f-18b3-4b49-b663-627155851ce8 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:45:20 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:45:20 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Creating image(s)
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "/opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "/opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "/opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.network.neutron [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Updating instance_info_cache with network_info: [{"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Releasing lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.compute.manager [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Instance network_info: |[{"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b4f2a2ea-29dc-4c8c-aecb-0306881d9d16 req-56ee7bfb-2694-4580-9860-8b343ee5729f service nova] Acquired lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.network.neutron [req-b4f2a2ea-29dc-4c8c-aecb-0306881d9d16 req-56ee7bfb-2694-4580-9860-8b343ee5729f service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Refreshing network info cache for port b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Start _get_guest_xml network_info=[{"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:45:20 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:20 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-402733805',display_name='tempest-ServerRescueNegativeTestJSON-server-402733805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-402733805',id=4,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70e84a09a76a44eb830e575db4321224',ramdisk_id='',reservation_id='r-e2h2pfno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-546430736',owner_user_name='tempest-ServerRescueNegativeTestJSON-546430736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:11Z,user_data=None,user_id='e77459bc3fa8496da1a089c460e32ed2',uuid=68cb788e-be1f-44fc-b65e-b908a5831ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converting VIF {"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:ba:92,bridge_name='br-int',has_traffic_filtering=True,id=b4a7d649-3cf1-4452-9f1d-430f0ce841ca,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a7d649-3c') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.objects.instance [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'pci_devices' on Instance uuid 68cb788e-be1f-44fc-b65e-b908a5831ae2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.179s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:45:20 user nova-compute[71325]:   <uuid>68cb788e-be1f-44fc-b65e-b908a5831ae2</uuid>
Apr 13 21:45:20 user nova-compute[71325]:   <name>instance-00000004</name>
Apr 13 21:45:20 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:45:20 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:45:20 user nova-compute[71325]:   <metadata>
Apr 13 21:45:20 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:45:20 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:45:20 user nova-compute[71325]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-402733805</nova:name>
Apr 13 21:45:20 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:45:20</nova:creationTime>
Apr 13 21:45:20 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:45:20 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:45:20 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:45:20 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:45:20 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:45:20 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:45:20 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:45:20 user nova-compute[71325]:       <nova:owner>
Apr 13 21:45:20 user nova-compute[71325]:         <nova:user uuid="e77459bc3fa8496da1a089c460e32ed2">tempest-ServerRescueNegativeTestJSON-546430736-project-member</nova:user>
Apr 13 21:45:20 user nova-compute[71325]:         <nova:project uuid="70e84a09a76a44eb830e575db4321224">tempest-ServerRescueNegativeTestJSON-546430736</nova:project>
Apr 13 21:45:20 user nova-compute[71325]:       </nova:owner>
Apr 13 21:45:20 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:45:20 user nova-compute[71325]:       <nova:ports>
Apr 13 21:45:20 user nova-compute[71325]:         <nova:port uuid="b4a7d649-3cf1-4452-9f1d-430f0ce841ca">
Apr 13 21:45:20 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 21:45:20 user nova-compute[71325]:         </nova:port>
Apr 13 21:45:20 user nova-compute[71325]:       </nova:ports>
Apr 13 21:45:20 user nova-compute[71325]:     </nova:instance>
Apr 13 21:45:20 user nova-compute[71325]:   </metadata>
Apr 13 21:45:20 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:45:20 user nova-compute[71325]:     <system>
Apr 13 21:45:20 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:45:20 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:45:20 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:45:20 user nova-compute[71325]:       <entry name="serial">68cb788e-be1f-44fc-b65e-b908a5831ae2</entry>
Apr 13 21:45:20 user nova-compute[71325]:       <entry name="uuid">68cb788e-be1f-44fc-b65e-b908a5831ae2</entry>
Apr 13 21:45:20 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:45:20 user nova-compute[71325]:     </system>
Apr 13 21:45:20 user nova-compute[71325]:   </sysinfo>
Apr 13 21:45:20 user nova-compute[71325]:   <os>
Apr 13 21:45:20 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:45:20 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:45:20 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:45:20 user nova-compute[71325]:   </os>
Apr 13 21:45:20 user nova-compute[71325]:   <features>
Apr 13 21:45:20 user nova-compute[71325]:     <acpi/>
Apr 13 21:45:20 user nova-compute[71325]:     <apic/>
Apr 13 21:45:20 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:45:20 user nova-compute[71325]:   </features>
Apr 13 21:45:20 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:45:20 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:45:20 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:45:20 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:45:20 user nova-compute[71325]:   </clock>
Apr 13 21:45:20 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:45:20 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:45:20 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:45:20 user nova-compute[71325]:   </cpu>
Apr 13 21:45:20 user nova-compute[71325]:   <devices>
Apr 13 21:45:20 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:45:20 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:45:20 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk"/>
Apr 13 21:45:20 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:45:20 user nova-compute[71325]:     </disk>
Apr 13 21:45:20 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:45:20 user nova-compute[71325]:       <mac address="fa:16:3e:73:ba:92"/>
Apr 13 21:45:20 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:20 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:45:20 user nova-compute[71325]:       <target dev="tapb4a7d649-3c"/>
Apr 13 21:45:20 user nova-compute[71325]:     </interface>
Apr 13 21:45:20 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:45:20 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/console.log" append="off"/>
Apr 13 21:45:20 user nova-compute[71325]:     </serial>
Apr 13 21:45:20 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:45:20 user nova-compute[71325]:     <video>
Apr 13 21:45:20 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:20 user nova-compute[71325]:     </video>
Apr 13 21:45:20 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:45:20 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:45:20 user nova-compute[71325]:     </rng>
Apr 13 21:45:20 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:45:20 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:45:20 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:45:20 user nova-compute[71325]:     </memballoon>
Apr 13 21:45:20 user nova-compute[71325]:   </devices>
Apr 13 21:45:20 user nova-compute[71325]: </domain>
Apr 13 21:45:20 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-402733805',display_name='tempest-ServerRescueNegativeTestJSON-server-402733805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-402733805',id=4,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70e84a09a76a44eb830e575db4321224',ramdisk_id='',reservation_id='r-e2h2pfno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-546430736',owner_user_name='tempest-ServerRescueNegativeTestJSON-546430736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:11Z,user_data=None,user_id='e77459bc3fa8496da1a089c460e32ed2',uuid=68cb788e-be1f-44fc-b65e-b908a5831ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converting VIF {"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:ba:92,bridge_name='br-int',has_traffic_filtering=True,id=b4a7d649-3cf1-4452-9f1d-430f0ce841ca,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a7d649-3c') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG os_vif [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:ba:92,bridge_name='br-int',has_traffic_filtering=True,id=b4a7d649-3cf1-4452-9f1d-430f0ce841ca,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a7d649-3c') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.policy [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3c1bbf573ea436293abf4debdecc515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4235a17cc95422dacb6386d4952fc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4a7d649-3c, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4a7d649-3c, col_values=(('external_ids', {'iface-id': 'b4a7d649-3cf1-4452-9f1d-430f0ce841ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:ba:92', 'vm-uuid': '68cb788e-be1f-44fc-b65e-b908a5831ae2'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:20 user nova-compute[71325]: INFO os_vif [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:ba:92,bridge_name='br-int',has_traffic_filtering=True,id=b4a7d649-3cf1-4452-9f1d-430f0ce841ca,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a7d649-3c')
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk 1073741824" returned: 0 in 0.046s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No VIF found with MAC fa:16:3e:73:ba:92, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.126s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Cannot resize image /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.objects.instance [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'migration_context' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Ensure instance console log exists: /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:21 user nova-compute[71325]: DEBUG nova.network.neutron [req-ec96c0d1-6c60-4782-a878-a149fcff4b25 req-ed57295c-806f-413e-b138-0901441d5055 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Updated VIF entry in instance network info cache for port ba4d973f-18b3-4b49-b663-627155851ce8. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:45:21 user nova-compute[71325]: DEBUG nova.network.neutron [req-ec96c0d1-6c60-4782-a878-a149fcff4b25 req-ed57295c-806f-413e-b138-0901441d5055 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Updating instance_info_cache with network_info: [{"id": "ba4d973f-18b3-4b49-b663-627155851ce8", "address": "fa:16:3e:36:cc:b4", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4d973f-18", "ovs_interfaceid": "ba4d973f-18b3-4b49-b663-627155851ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ec96c0d1-6c60-4782-a878-a149fcff4b25 req-ed57295c-806f-413e-b138-0901441d5055 service nova] Releasing lock "refresh_cache-8645ede7-1e10-4520-8092-6cc6dfc3d82a" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:21 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Successfully updated port: a9262ff5-d93b-430d-839d-39cdfccb47c4 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:45:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "refresh_cache-3a8e8627-03d4-4a17-a324-93def1017101" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquired lock "refresh_cache-3a8e8627-03d4-4a17-a324-93def1017101" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:21 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:45:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Received event network-changed-a9262ff5-d93b-430d-839d-39cdfccb47c4 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Refreshing instance network info cache due to event network-changed-a9262ff5-d93b-430d-839d-39cdfccb47c4. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:45:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] Acquiring lock "refresh_cache-3a8e8627-03d4-4a17-a324-93def1017101" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:21 user nova-compute[71325]: DEBUG nova.network.neutron [req-b4f2a2ea-29dc-4c8c-aecb-0306881d9d16 req-56ee7bfb-2694-4580-9860-8b343ee5729f service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Updated VIF entry in instance network info cache for port b4a7d649-3cf1-4452-9f1d-430f0ce841ca. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:45:21 user nova-compute[71325]: DEBUG nova.network.neutron [req-b4f2a2ea-29dc-4c8c-aecb-0306881d9d16 req-56ee7bfb-2694-4580-9860-8b343ee5729f service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Updating instance_info_cache with network_info: [{"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b4f2a2ea-29dc-4c8c-aecb-0306881d9d16 req-56ee7bfb-2694-4580-9860-8b343ee5729f service nova] Releasing lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:21 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:45:22 user nova-compute[71325]: DEBUG nova.network.neutron [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Successfully updated port: e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:45:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquired lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:22 user nova-compute[71325]: DEBUG nova.network.neutron [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:45:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-2cb4bd66-2401-40d5-83fd-78adfddfa1d7 req-fd314a1f-08a0-42da-9c58-d5b22faa176b service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-changed-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-2cb4bd66-2401-40d5-83fd-78adfddfa1d7 req-fd314a1f-08a0-42da-9c58-d5b22faa176b service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Refreshing instance network info cache due to event network-changed-e918ab8f-9fcd-47df-974d-eb6568414011. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:45:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2cb4bd66-2401-40d5-83fd-78adfddfa1d7 req-fd314a1f-08a0-42da-9c58-d5b22faa176b service nova] Acquiring lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:22 user nova-compute[71325]: DEBUG nova.network.neutron [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:45:22 user nova-compute[71325]: DEBUG nova.network.neutron [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Successfully created port: f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Updating instance_info_cache with network_info: [{"id": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "address": "fa:16:3e:97:cb:19", "network": {"id": "77c75177-3563-451c-a6d0-02f4c7cd7a7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1925575035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45aed26c3fb143cab8c3c1599f70d858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9262ff5-d9", "ovs_interfaceid": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Releasing lock "refresh_cache-3a8e8627-03d4-4a17-a324-93def1017101" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Instance network_info: |[{"id": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "address": "fa:16:3e:97:cb:19", "network": {"id": "77c75177-3563-451c-a6d0-02f4c7cd7a7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1925575035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45aed26c3fb143cab8c3c1599f70d858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9262ff5-d9", "ovs_interfaceid": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] Acquired lock "refresh_cache-3a8e8627-03d4-4a17-a324-93def1017101" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.network.neutron [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Refreshing network info cache for port a9262ff5-d93b-430d-839d-39cdfccb47c4 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Start _get_guest_xml network_info=[{"id": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "address": "fa:16:3e:97:cb:19", "network": {"id": "77c75177-3563-451c-a6d0-02f4c7cd7a7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1925575035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45aed26c3fb143cab8c3c1599f70d858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9262ff5-d9", "ovs_interfaceid": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:45:23 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:23 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1801509642',display_name='tempest-DeleteServersTestJSON-server-1801509642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1801509642',id=5,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45aed26c3fb143cab8c3c1599f70d858',ramdisk_id='',reservation_id='r-4r0fmyj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-698852050',owner_user_name='tempest-DeleteServersTestJSON-698852050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:15Z,user_data=None,user_id='7299dc5fc1ad4f3eb769eda4dac5abe1',uuid=3a8e8627-03d4-4a17-a324-93def1017101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "address": "fa:16:3e:97:cb:19", "network": {"id": "77c75177-3563-451c-a6d0-02f4c7cd7a7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1925575035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45aed26c3fb143cab8c3c1599f70d858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9262ff5-d9", "ovs_interfaceid": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Converting VIF {"id": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "address": "fa:16:3e:97:cb:19", "network": {"id": "77c75177-3563-451c-a6d0-02f4c7cd7a7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1925575035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45aed26c3fb143cab8c3c1599f70d858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9262ff5-d9", "ovs_interfaceid": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=a9262ff5-d93b-430d-839d-39cdfccb47c4,network=Network(77c75177-3563-451c-a6d0-02f4c7cd7a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9262ff5-d9') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a8e8627-03d4-4a17-a324-93def1017101 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.network.neutron [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updating instance_info_cache with network_info: [{"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:45:23 user nova-compute[71325]:   <uuid>3a8e8627-03d4-4a17-a324-93def1017101</uuid>
Apr 13 21:45:23 user nova-compute[71325]:   <name>instance-00000005</name>
Apr 13 21:45:23 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:45:23 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:45:23 user nova-compute[71325]:   <metadata>
Apr 13 21:45:23 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:45:23 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:45:23 user nova-compute[71325]:       <nova:name>tempest-DeleteServersTestJSON-server-1801509642</nova:name>
Apr 13 21:45:23 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:45:23</nova:creationTime>
Apr 13 21:45:23 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:45:23 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:45:23 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:45:23 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:45:23 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:45:23 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:45:23 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:45:23 user nova-compute[71325]:       <nova:owner>
Apr 13 21:45:23 user nova-compute[71325]:         <nova:user uuid="7299dc5fc1ad4f3eb769eda4dac5abe1">tempest-DeleteServersTestJSON-698852050-project-member</nova:user>
Apr 13 21:45:23 user nova-compute[71325]:         <nova:project uuid="45aed26c3fb143cab8c3c1599f70d858">tempest-DeleteServersTestJSON-698852050</nova:project>
Apr 13 21:45:23 user nova-compute[71325]:       </nova:owner>
Apr 13 21:45:23 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:45:23 user nova-compute[71325]:       <nova:ports>
Apr 13 21:45:23 user nova-compute[71325]:         <nova:port uuid="a9262ff5-d93b-430d-839d-39cdfccb47c4">
Apr 13 21:45:23 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 21:45:23 user nova-compute[71325]:         </nova:port>
Apr 13 21:45:23 user nova-compute[71325]:       </nova:ports>
Apr 13 21:45:23 user nova-compute[71325]:     </nova:instance>
Apr 13 21:45:23 user nova-compute[71325]:   </metadata>
Apr 13 21:45:23 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:45:23 user nova-compute[71325]:     <system>
Apr 13 21:45:23 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:45:23 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:45:23 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:45:23 user nova-compute[71325]:       <entry name="serial">3a8e8627-03d4-4a17-a324-93def1017101</entry>
Apr 13 21:45:23 user nova-compute[71325]:       <entry name="uuid">3a8e8627-03d4-4a17-a324-93def1017101</entry>
Apr 13 21:45:23 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:45:23 user nova-compute[71325]:     </system>
Apr 13 21:45:23 user nova-compute[71325]:   </sysinfo>
Apr 13 21:45:23 user nova-compute[71325]:   <os>
Apr 13 21:45:23 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:45:23 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:45:23 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:45:23 user nova-compute[71325]:   </os>
Apr 13 21:45:23 user nova-compute[71325]:   <features>
Apr 13 21:45:23 user nova-compute[71325]:     <acpi/>
Apr 13 21:45:23 user nova-compute[71325]:     <apic/>
Apr 13 21:45:23 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:45:23 user nova-compute[71325]:   </features>
Apr 13 21:45:23 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:45:23 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:45:23 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:45:23 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:45:23 user nova-compute[71325]:   </clock>
Apr 13 21:45:23 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:45:23 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:45:23 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:45:23 user nova-compute[71325]:   </cpu>
Apr 13 21:45:23 user nova-compute[71325]:   <devices>
Apr 13 21:45:23 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:45:23 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:45:23 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk"/>
Apr 13 21:45:23 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:45:23 user nova-compute[71325]:     </disk>
Apr 13 21:45:23 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:45:23 user nova-compute[71325]:       <mac address="fa:16:3e:97:cb:19"/>
Apr 13 21:45:23 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:23 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:45:23 user nova-compute[71325]:       <target dev="tapa9262ff5-d9"/>
Apr 13 21:45:23 user nova-compute[71325]:     </interface>
Apr 13 21:45:23 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:45:23 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/console.log" append="off"/>
Apr 13 21:45:23 user nova-compute[71325]:     </serial>
Apr 13 21:45:23 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:45:23 user nova-compute[71325]:     <video>
Apr 13 21:45:23 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:23 user nova-compute[71325]:     </video>
Apr 13 21:45:23 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:45:23 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:45:23 user nova-compute[71325]:     </rng>
Apr 13 21:45:23 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:45:23 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:45:23 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:45:23 user nova-compute[71325]:     </memballoon>
Apr 13 21:45:23 user nova-compute[71325]:   </devices>
Apr 13 21:45:23 user nova-compute[71325]: </domain>
Apr 13 21:45:23 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1801509642',display_name='tempest-DeleteServersTestJSON-server-1801509642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1801509642',id=5,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45aed26c3fb143cab8c3c1599f70d858',ramdisk_id='',reservation_id='r-4r0fmyj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-698852050',owner_user_name='tempest-DeleteServersTestJSON-698852050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:15Z,user_data=None,user_id='7299dc5fc1ad4f3eb769eda4dac5abe1',uuid=3a8e8627-03d4-4a17-a324-93def1017101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "address": "fa:16:3e:97:cb:19", "network": {"id": "77c75177-3563-451c-a6d0-02f4c7cd7a7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1925575035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45aed26c3fb143cab8c3c1599f70d858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9262ff5-d9", "ovs_interfaceid": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Converting VIF {"id": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "address": "fa:16:3e:97:cb:19", "network": {"id": "77c75177-3563-451c-a6d0-02f4c7cd7a7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1925575035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45aed26c3fb143cab8c3c1599f70d858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9262ff5-d9", "ovs_interfaceid": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=a9262ff5-d93b-430d-839d-39cdfccb47c4,network=Network(77c75177-3563-451c-a6d0-02f4c7cd7a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9262ff5-d9') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG os_vif [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=a9262ff5-d93b-430d-839d-39cdfccb47c4,network=Network(77c75177-3563-451c-a6d0-02f4c7cd7a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9262ff5-d9') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9262ff5-d9, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9262ff5-d9, col_values=(('external_ids', {'iface-id': 'a9262ff5-d93b-430d-839d-39cdfccb47c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:cb:19', 'vm-uuid': '3a8e8627-03d4-4a17-a324-93def1017101'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Releasing lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Instance network_info: |[{"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2cb4bd66-2401-40d5-83fd-78adfddfa1d7 req-fd314a1f-08a0-42da-9c58-d5b22faa176b service nova] Acquired lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.network.neutron [req-2cb4bd66-2401-40d5-83fd-78adfddfa1d7 req-fd314a1f-08a0-42da-9c58-d5b22faa176b service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Refreshing network info cache for port e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Start _get_guest_xml network_info=[{"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:23 user nova-compute[71325]: INFO os_vif [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=a9262ff5-d93b-430d-839d-39cdfccb47c4,network=Network(77c75177-3563-451c-a6d0-02f4c7cd7a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9262ff5-d9')
Apr 13 21:45:23 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:23 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1025681919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1025681919',id=6,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7Ml5lpGb1VqwPVwkwwsf5pboDo62epDSWqFRNEqAUVYF/2w516xO62Qmmp9j0l22MQEwYg4/k1ON4am0hAmYwpEbqC0e1pEBIaEp/IKSH66LA6p3lpAdZWEotG6J5hwQ==',key_name='tempest-keypair-1819128718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73c23bc3e8b14441b4622095502b5dae',ramdisk_id='',reservation_id='r-m0kiebsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-710815470',owner_user_name='tempest-AttachVolumeShelveTestJSON-710815470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f151b673e3d47acb9c3ed9b9ecaf687',uuid=eaff33f4-c1f5-45c5-b54f-555d1c66e8c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converting VIF {"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:19:65,bridge_name='br-int',has_traffic_filtering=True,id=e918ab8f-9fcd-47df-974d-eb6568414011,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape918ab8f-9f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.objects.instance [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'pci_devices' on Instance uuid eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:45:23 user nova-compute[71325]:   <uuid>eaff33f4-c1f5-45c5-b54f-555d1c66e8c7</uuid>
Apr 13 21:45:23 user nova-compute[71325]:   <name>instance-00000006</name>
Apr 13 21:45:23 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:45:23 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:45:23 user nova-compute[71325]:   <metadata>
Apr 13 21:45:23 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:45:23 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:45:23 user nova-compute[71325]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1025681919</nova:name>
Apr 13 21:45:23 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:45:23</nova:creationTime>
Apr 13 21:45:23 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:45:23 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:45:23 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:45:23 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:45:23 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:45:23 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:45:23 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:45:23 user nova-compute[71325]:       <nova:owner>
Apr 13 21:45:23 user nova-compute[71325]:         <nova:user uuid="3f151b673e3d47acb9c3ed9b9ecaf687">tempest-AttachVolumeShelveTestJSON-710815470-project-member</nova:user>
Apr 13 21:45:23 user nova-compute[71325]:         <nova:project uuid="73c23bc3e8b14441b4622095502b5dae">tempest-AttachVolumeShelveTestJSON-710815470</nova:project>
Apr 13 21:45:23 user nova-compute[71325]:       </nova:owner>
Apr 13 21:45:23 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:45:23 user nova-compute[71325]:       <nova:ports>
Apr 13 21:45:23 user nova-compute[71325]:         <nova:port uuid="e918ab8f-9fcd-47df-974d-eb6568414011">
Apr 13 21:45:23 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 21:45:23 user nova-compute[71325]:         </nova:port>
Apr 13 21:45:23 user nova-compute[71325]:       </nova:ports>
Apr 13 21:45:23 user nova-compute[71325]:     </nova:instance>
Apr 13 21:45:23 user nova-compute[71325]:   </metadata>
Apr 13 21:45:23 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:45:23 user nova-compute[71325]:     <system>
Apr 13 21:45:23 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:45:23 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:45:23 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:45:23 user nova-compute[71325]:       <entry name="serial">eaff33f4-c1f5-45c5-b54f-555d1c66e8c7</entry>
Apr 13 21:45:23 user nova-compute[71325]:       <entry name="uuid">eaff33f4-c1f5-45c5-b54f-555d1c66e8c7</entry>
Apr 13 21:45:23 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:45:23 user nova-compute[71325]:     </system>
Apr 13 21:45:23 user nova-compute[71325]:   </sysinfo>
Apr 13 21:45:23 user nova-compute[71325]:   <os>
Apr 13 21:45:23 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:45:23 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:45:23 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:45:23 user nova-compute[71325]:   </os>
Apr 13 21:45:23 user nova-compute[71325]:   <features>
Apr 13 21:45:23 user nova-compute[71325]:     <acpi/>
Apr 13 21:45:23 user nova-compute[71325]:     <apic/>
Apr 13 21:45:23 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:45:23 user nova-compute[71325]:   </features>
Apr 13 21:45:23 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:45:23 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:45:23 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:45:23 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:45:23 user nova-compute[71325]:   </clock>
Apr 13 21:45:23 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:45:23 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:45:23 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:45:23 user nova-compute[71325]:   </cpu>
Apr 13 21:45:23 user nova-compute[71325]:   <devices>
Apr 13 21:45:23 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:45:23 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:45:23 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk"/>
Apr 13 21:45:23 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:45:23 user nova-compute[71325]:     </disk>
Apr 13 21:45:23 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:45:23 user nova-compute[71325]:       <mac address="fa:16:3e:7c:19:65"/>
Apr 13 21:45:23 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:23 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:45:23 user nova-compute[71325]:       <target dev="tape918ab8f-9f"/>
Apr 13 21:45:23 user nova-compute[71325]:     </interface>
Apr 13 21:45:23 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:45:23 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/console.log" append="off"/>
Apr 13 21:45:23 user nova-compute[71325]:     </serial>
Apr 13 21:45:23 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:45:23 user nova-compute[71325]:     <video>
Apr 13 21:45:23 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:23 user nova-compute[71325]:     </video>
Apr 13 21:45:23 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:45:23 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:45:23 user nova-compute[71325]:     </rng>
Apr 13 21:45:23 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:45:23 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:45:23 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:45:23 user nova-compute[71325]:     </memballoon>
Apr 13 21:45:23 user nova-compute[71325]:   </devices>
Apr 13 21:45:23 user nova-compute[71325]: </domain>
Apr 13 21:45:23 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1025681919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1025681919',id=6,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7Ml5lpGb1VqwPVwkwwsf5pboDo62epDSWqFRNEqAUVYF/2w516xO62Qmmp9j0l22MQEwYg4/k1ON4am0hAmYwpEbqC0e1pEBIaEp/IKSH66LA6p3lpAdZWEotG6J5hwQ==',key_name='tempest-keypair-1819128718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73c23bc3e8b14441b4622095502b5dae',ramdisk_id='',reservation_id='r-m0kiebsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-710815470',owner_user_name='tempest-AttachVolumeShelveTestJSON-710815470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f151b673e3d47acb9c3ed9b9ecaf687',uuid=eaff33f4-c1f5-45c5-b54f-555d1c66e8c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converting VIF {"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:19:65,bridge_name='br-int',has_traffic_filtering=True,id=e918ab8f-9fcd-47df-974d-eb6568414011,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape918ab8f-9f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG os_vif [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:19:65,bridge_name='br-int',has_traffic_filtering=True,id=e918ab8f-9fcd-47df-974d-eb6568414011,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape918ab8f-9f') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape918ab8f-9f, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape918ab8f-9f, col_values=(('external_ids', {'iface-id': 'e918ab8f-9fcd-47df-974d-eb6568414011', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:19:65', 'vm-uuid': 'eaff33f4-c1f5-45c5-b54f-555d1c66e8c7'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] No VIF found with MAC fa:16:3e:97:cb:19, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:23 user nova-compute[71325]: INFO os_vif [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:19:65,bridge_name='br-int',has_traffic_filtering=True,id=e918ab8f-9fcd-47df-974d-eb6568414011,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape918ab8f-9f')
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG nova.network.neutron [req-2cb4bd66-2401-40d5-83fd-78adfddfa1d7 req-fd314a1f-08a0-42da-9c58-d5b22faa176b service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updated VIF entry in instance network info cache for port e918ab8f-9fcd-47df-974d-eb6568414011. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG nova.network.neutron [req-2cb4bd66-2401-40d5-83fd-78adfddfa1d7 req-fd314a1f-08a0-42da-9c58-d5b22faa176b service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updating instance_info_cache with network_info: [{"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2cb4bd66-2401-40d5-83fd-78adfddfa1d7 req-fd314a1f-08a0-42da-9c58-d5b22faa176b service nova] Releasing lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG nova.network.neutron [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Successfully updated port: f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquired lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG nova.network.neutron [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG nova.compute.manager [req-43aee76a-974d-4874-beda-1a9c1434cda9 req-a6f7d6f9-0a36-4861-8966-91ad044ebb49 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-changed-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG nova.compute.manager [req-43aee76a-974d-4874-beda-1a9c1434cda9 req-a6f7d6f9-0a36-4861-8966-91ad044ebb49 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Refreshing instance network info cache due to event network-changed-f0a7bc69-be17-49d2-94fc-40541afce8ed. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-43aee76a-974d-4874-beda-1a9c1434cda9 req-a6f7d6f9-0a36-4861-8966-91ad044ebb49 service nova] Acquiring lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG nova.network.neutron [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG nova.network.neutron [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Updated VIF entry in instance network info cache for port a9262ff5-d93b-430d-839d-39cdfccb47c4. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG nova.network.neutron [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Updating instance_info_cache with network_info: [{"id": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "address": "fa:16:3e:97:cb:19", "network": {"id": "77c75177-3563-451c-a6d0-02f4c7cd7a7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1925575035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45aed26c3fb143cab8c3c1599f70d858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9262ff5-d9", "ovs_interfaceid": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] Releasing lock "refresh_cache-3a8e8627-03d4-4a17-a324-93def1017101" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG nova.compute.manager [req-8b78e0ee-0db1-4ad9-9083-b1a7bb86fd62 req-e2235dd2-f4f8-409e-954c-6524bb5226b4 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Received event network-vif-plugged-ba4d973f-18b3-4b49-b663-627155851ce8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8b78e0ee-0db1-4ad9-9083-b1a7bb86fd62 req-e2235dd2-f4f8-409e-954c-6524bb5226b4 service nova] Acquiring lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8b78e0ee-0db1-4ad9-9083-b1a7bb86fd62 req-e2235dd2-f4f8-409e-954c-6524bb5226b4 service nova] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8b78e0ee-0db1-4ad9-9083-b1a7bb86fd62 req-e2235dd2-f4f8-409e-954c-6524bb5226b4 service nova] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:24 user nova-compute[71325]: DEBUG nova.compute.manager [req-8b78e0ee-0db1-4ad9-9083-b1a7bb86fd62 req-e2235dd2-f4f8-409e-954c-6524bb5226b4 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] No waiting events found dispatching network-vif-plugged-ba4d973f-18b3-4b49-b663-627155851ce8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:24 user nova-compute[71325]: WARNING nova.compute.manager [req-8b78e0ee-0db1-4ad9-9083-b1a7bb86fd62 req-e2235dd2-f4f8-409e-954c-6524bb5226b4 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Received unexpected event network-vif-plugged-ba4d973f-18b3-4b49-b663-627155851ce8 for instance with vm_state building and task_state spawning.
Apr 13 21:45:25 user nova-compute[71325]: DEBUG nova.network.neutron [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updating instance_info_cache with network_info: [{"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Releasing lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Instance network_info: |[{"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:45:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-43aee76a-974d-4874-beda-1a9c1434cda9 req-a6f7d6f9-0a36-4861-8966-91ad044ebb49 service nova] Acquired lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:25 user nova-compute[71325]: DEBUG nova.network.neutron [req-43aee76a-974d-4874-beda-1a9c1434cda9 req-a6f7d6f9-0a36-4861-8966-91ad044ebb49 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Refreshing network info cache for port f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:45:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Start _get_guest_xml network_info=[{"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:45:25 user nova-compute[71325]: DEBUG nova.compute.manager [req-05c790fb-d8c5-4a54-abe5-db8b908e898c req-82021838-d6f6-41af-99b7-b8cc3c007885 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-05c790fb-d8c5-4a54-abe5-db8b908e898c req-82021838-d6f6-41af-99b7-b8cc3c007885 service nova] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-05c790fb-d8c5-4a54-abe5-db8b908e898c req-82021838-d6f6-41af-99b7-b8cc3c007885 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-05c790fb-d8c5-4a54-abe5-db8b908e898c req-82021838-d6f6-41af-99b7-b8cc3c007885 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:25 user nova-compute[71325]: DEBUG nova.compute.manager [req-05c790fb-d8c5-4a54-abe5-db8b908e898c req-82021838-d6f6-41af-99b7-b8cc3c007885 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] No waiting events found dispatching network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:25 user nova-compute[71325]: WARNING nova.compute.manager [req-05c790fb-d8c5-4a54-abe5-db8b908e898c req-82021838-d6f6-41af-99b7-b8cc3c007885 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received unexpected event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance with vm_state building and task_state spawning.
Apr 13 21:45:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG nova.network.neutron [req-43aee76a-974d-4874-beda-1a9c1434cda9 req-a6f7d6f9-0a36-4861-8966-91ad044ebb49 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updated VIF entry in instance network info cache for port f0a7bc69-be17-49d2-94fc-40541afce8ed. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG nova.network.neutron [req-43aee76a-974d-4874-beda-1a9c1434cda9 req-a6f7d6f9-0a36-4861-8966-91ad044ebb49 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updating instance_info_cache with network_info: [{"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-43aee76a-974d-4874-beda-1a9c1434cda9 req-a6f7d6f9-0a36-4861-8966-91ad044ebb49 service nova] Releasing lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG nova.compute.manager [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG nova.compute.manager [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] No waiting events found dispatching network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:26 user nova-compute[71325]: WARNING nova.compute.manager [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received unexpected event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 for instance with vm_state building and task_state spawning.
Apr 13 21:45:26 user nova-compute[71325]: DEBUG nova.compute.manager [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG nova.compute.manager [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] No waiting events found dispatching network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:26 user nova-compute[71325]: WARNING nova.compute.manager [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received unexpected event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 for instance with vm_state building and task_state spawning.
Apr 13 21:45:26 user nova-compute[71325]: DEBUG nova.compute.manager [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received event network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Acquiring lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG nova.compute.manager [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] No waiting events found dispatching network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:26 user nova-compute[71325]: WARNING nova.compute.manager [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received unexpected event network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance with vm_state building and task_state spawning.
Apr 13 21:45:26 user nova-compute[71325]: DEBUG nova.compute.manager [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received event network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Acquiring lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG nova.compute.manager [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] No waiting events found dispatching network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:26 user nova-compute[71325]: WARNING nova.compute.manager [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received unexpected event network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance with vm_state building and task_state spawning.
Apr 13 21:45:26 user nova-compute[71325]: DEBUG nova.compute.manager [req-a235d912-dfcb-4b31-90e3-ccc3003717cf req-61fa6ce5-8d72-48e0-9c44-6fc6b01414c3 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Received event network-vif-plugged-ba4d973f-18b3-4b49-b663-627155851ce8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a235d912-dfcb-4b31-90e3-ccc3003717cf req-61fa6ce5-8d72-48e0-9c44-6fc6b01414c3 service nova] Acquiring lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a235d912-dfcb-4b31-90e3-ccc3003717cf req-61fa6ce5-8d72-48e0-9c44-6fc6b01414c3 service nova] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a235d912-dfcb-4b31-90e3-ccc3003717cf req-61fa6ce5-8d72-48e0-9c44-6fc6b01414c3 service nova] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:26 user nova-compute[71325]: DEBUG nova.compute.manager [req-a235d912-dfcb-4b31-90e3-ccc3003717cf req-61fa6ce5-8d72-48e0-9c44-6fc6b01414c3 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] No waiting events found dispatching network-vif-plugged-ba4d973f-18b3-4b49-b663-627155851ce8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:26 user nova-compute[71325]: WARNING nova.compute.manager [req-a235d912-dfcb-4b31-90e3-ccc3003717cf req-61fa6ce5-8d72-48e0-9c44-6fc6b01414c3 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Received unexpected event network-vif-plugged-ba4d973f-18b3-4b49-b663-627155851ce8 for instance with vm_state building and task_state spawning.
Apr 13 21:45:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-3d62b52f-3ffc-458d-929a-379f0a6412a4 req-56dfa8b5-2ce0-4beb-a443-a0dae7c70f8a service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3d62b52f-3ffc-458d-929a-379f0a6412a4 req-56dfa8b5-2ce0-4beb-a443-a0dae7c70f8a service nova] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3d62b52f-3ffc-458d-929a-379f0a6412a4 req-56dfa8b5-2ce0-4beb-a443-a0dae7c70f8a service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3d62b52f-3ffc-458d-929a-379f0a6412a4 req-56dfa8b5-2ce0-4beb-a443-a0dae7c70f8a service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-3d62b52f-3ffc-458d-929a-379f0a6412a4 req-56dfa8b5-2ce0-4beb-a443-a0dae7c70f8a service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] No waiting events found dispatching network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:27 user nova-compute[71325]: WARNING nova.compute.manager [req-3d62b52f-3ffc-458d-929a-379f0a6412a4 req-56dfa8b5-2ce0-4beb-a443-a0dae7c70f8a service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received unexpected event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance with vm_state building and task_state spawning.
Apr 13 21:45:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422328.41463, ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:28 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] VM Resumed (Lifecycle Event)
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:28 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Instance spawned successfully.
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:28 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:28 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1586666894',display_name='tempest-ServerStableDeviceRescueTest-server-1586666894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1586666894',id=7,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEyy8lvN5JxTozYg9ByYCQUUKEcNGunFuCkWcpXFzcQgw9m/DW6nJHXR8e8LkSDM7KZy5/LgblZ7q8T1OTnPbj9wKvTJ0iV6fPco0NWPjXLrW2GtaHDcybWSGRNToUsWA==',key_name='tempest-keypair-1172830782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4235a17cc95422dacb6386d4952fc8e',ramdisk_id='',reservation_id='r-z7lko0o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1552707388',owner_user_name='tempest-ServerStableDeviceRescueTest-1552707388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c1bbf573ea436293abf4debdecc515',uuid=af4efbd5-a4c1-4e7c-b274-92413f86f2a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Converting VIF {"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=f0a7bc69-be17-49d2-94fc-40541afce8ed,network=Network(7401a99a-44e9-442d-8f64-8591e14e8388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a7bc69-be') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.objects.instance [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'pci_devices' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:28 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422328.4215531, ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:28 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] VM Started (Lifecycle Event)
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:45:28 user nova-compute[71325]:   <uuid>af4efbd5-a4c1-4e7c-b274-92413f86f2a8</uuid>
Apr 13 21:45:28 user nova-compute[71325]:   <name>instance-00000007</name>
Apr 13 21:45:28 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:45:28 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:45:28 user nova-compute[71325]:   <metadata>
Apr 13 21:45:28 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:45:28 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:45:28 user nova-compute[71325]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1586666894</nova:name>
Apr 13 21:45:28 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:45:28</nova:creationTime>
Apr 13 21:45:28 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:45:28 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:45:28 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:45:28 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:45:28 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:45:28 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:45:28 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:45:28 user nova-compute[71325]:       <nova:owner>
Apr 13 21:45:28 user nova-compute[71325]:         <nova:user uuid="c3c1bbf573ea436293abf4debdecc515">tempest-ServerStableDeviceRescueTest-1552707388-project-member</nova:user>
Apr 13 21:45:28 user nova-compute[71325]:         <nova:project uuid="d4235a17cc95422dacb6386d4952fc8e">tempest-ServerStableDeviceRescueTest-1552707388</nova:project>
Apr 13 21:45:28 user nova-compute[71325]:       </nova:owner>
Apr 13 21:45:28 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:45:28 user nova-compute[71325]:       <nova:ports>
Apr 13 21:45:28 user nova-compute[71325]:         <nova:port uuid="f0a7bc69-be17-49d2-94fc-40541afce8ed">
Apr 13 21:45:28 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 21:45:28 user nova-compute[71325]:         </nova:port>
Apr 13 21:45:28 user nova-compute[71325]:       </nova:ports>
Apr 13 21:45:28 user nova-compute[71325]:     </nova:instance>
Apr 13 21:45:28 user nova-compute[71325]:   </metadata>
Apr 13 21:45:28 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:45:28 user nova-compute[71325]:     <system>
Apr 13 21:45:28 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:45:28 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:45:28 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:45:28 user nova-compute[71325]:       <entry name="serial">af4efbd5-a4c1-4e7c-b274-92413f86f2a8</entry>
Apr 13 21:45:28 user nova-compute[71325]:       <entry name="uuid">af4efbd5-a4c1-4e7c-b274-92413f86f2a8</entry>
Apr 13 21:45:28 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:45:28 user nova-compute[71325]:     </system>
Apr 13 21:45:28 user nova-compute[71325]:   </sysinfo>
Apr 13 21:45:28 user nova-compute[71325]:   <os>
Apr 13 21:45:28 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:45:28 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:45:28 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:45:28 user nova-compute[71325]:   </os>
Apr 13 21:45:28 user nova-compute[71325]:   <features>
Apr 13 21:45:28 user nova-compute[71325]:     <acpi/>
Apr 13 21:45:28 user nova-compute[71325]:     <apic/>
Apr 13 21:45:28 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:45:28 user nova-compute[71325]:   </features>
Apr 13 21:45:28 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:45:28 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:45:28 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:45:28 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:45:28 user nova-compute[71325]:   </clock>
Apr 13 21:45:28 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:45:28 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:45:28 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:45:28 user nova-compute[71325]:   </cpu>
Apr 13 21:45:28 user nova-compute[71325]:   <devices>
Apr 13 21:45:28 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:45:28 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:45:28 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk"/>
Apr 13 21:45:28 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:45:28 user nova-compute[71325]:     </disk>
Apr 13 21:45:28 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:45:28 user nova-compute[71325]:       <mac address="fa:16:3e:f2:21:5b"/>
Apr 13 21:45:28 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:28 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:45:28 user nova-compute[71325]:       <target dev="tapf0a7bc69-be"/>
Apr 13 21:45:28 user nova-compute[71325]:     </interface>
Apr 13 21:45:28 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:45:28 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/console.log" append="off"/>
Apr 13 21:45:28 user nova-compute[71325]:     </serial>
Apr 13 21:45:28 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:45:28 user nova-compute[71325]:     <video>
Apr 13 21:45:28 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:28 user nova-compute[71325]:     </video>
Apr 13 21:45:28 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:45:28 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:45:28 user nova-compute[71325]:     </rng>
Apr 13 21:45:28 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:45:28 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:45:28 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:45:28 user nova-compute[71325]:     </memballoon>
Apr 13 21:45:28 user nova-compute[71325]:   </devices>
Apr 13 21:45:28 user nova-compute[71325]: </domain>
Apr 13 21:45:28 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1586666894',display_name='tempest-ServerStableDeviceRescueTest-server-1586666894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1586666894',id=7,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEyy8lvN5JxTozYg9ByYCQUUKEcNGunFuCkWcpXFzcQgw9m/DW6nJHXR8e8LkSDM7KZy5/LgblZ7q8T1OTnPbj9wKvTJ0iV6fPco0NWPjXLrW2GtaHDcybWSGRNToUsWA==',key_name='tempest-keypair-1172830782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4235a17cc95422dacb6386d4952fc8e',ramdisk_id='',reservation_id='r-z7lko0o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1552707388',owner_user_name='tempest-ServerStableDeviceRescueTest-1552707388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c1bbf573ea436293abf4debdecc515',uuid=af4efbd5-a4c1-4e7c-b274-92413f86f2a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Converting VIF {"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=f0a7bc69-be17-49d2-94fc-40541afce8ed,network=Network(7401a99a-44e9-442d-8f64-8591e14e8388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a7bc69-be') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG os_vif [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=f0a7bc69-be17-49d2-94fc-40541afce8ed,network=Network(7401a99a-44e9-442d-8f64-8591e14e8388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a7bc69-be') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.compute.manager [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Received event network-vif-plugged-a9262ff5-d93b-430d-839d-39cdfccb47c4 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] Acquiring lock "3a8e8627-03d4-4a17-a324-93def1017101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] Lock "3a8e8627-03d4-4a17-a324-93def1017101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] Lock "3a8e8627-03d4-4a17-a324-93def1017101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.compute.manager [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] No waiting events found dispatching network-vif-plugged-a9262ff5-d93b-430d-839d-39cdfccb47c4 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:28 user nova-compute[71325]: WARNING nova.compute.manager [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Received unexpected event network-vif-plugged-a9262ff5-d93b-430d-839d-39cdfccb47c4 for instance with vm_state building and task_state spawning.
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.compute.manager [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Received event network-vif-plugged-a9262ff5-d93b-430d-839d-39cdfccb47c4 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] Acquiring lock "3a8e8627-03d4-4a17-a324-93def1017101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] Lock "3a8e8627-03d4-4a17-a324-93def1017101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] Lock "3a8e8627-03d4-4a17-a324-93def1017101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.compute.manager [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] No waiting events found dispatching network-vif-plugged-a9262ff5-d93b-430d-839d-39cdfccb47c4 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:28 user nova-compute[71325]: WARNING nova.compute.manager [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Received unexpected event network-vif-plugged-a9262ff5-d93b-430d-839d-39cdfccb47c4 for instance with vm_state building and task_state spawning.
Apr 13 21:45:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0a7bc69-be, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0a7bc69-be, col_values=(('external_ids', {'iface-id': 'f0a7bc69-be17-49d2-94fc-40541afce8ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:21:5b', 'vm-uuid': 'af4efbd5-a4c1-4e7c-b274-92413f86f2a8'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] No VIF found with MAC fa:16:3e:7c:19:65, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:28 user nova-compute[71325]: INFO os_vif [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=f0a7bc69-be17-49d2-94fc-40541afce8ed,network=Network(7401a99a-44e9-442d-8f64-8591e14e8388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a7bc69-be')
Apr 13 21:45:28 user nova-compute[71325]: INFO nova.compute.manager [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Took 17.92 seconds to spawn the instance on the hypervisor.
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:45:28 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Instance spawned successfully.
Apr 13 21:45:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422328.8710315, 8645ede7-1e10-4520-8092-6cc6dfc3d82a => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] VM Resumed (Lifecycle Event)
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Instance spawned successfully.
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] No VIF found with MAC fa:16:3e:f2:21:5b, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Took 19.31 seconds to build instance.
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Took 19.27 seconds to spawn the instance on the hypervisor.
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.826s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422328.8711693, 8645ede7-1e10-4520-8092-6cc6dfc3d82a => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] VM Started (Lifecycle Event)
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Took 17.95 seconds to spawn the instance on the hypervisor.
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Instance spawned successfully.
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422328.9328377, 68cb788e-be1f-44fc-b65e-b908a5831ae2 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] VM Resumed (Lifecycle Event)
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Took 20.88 seconds to build instance.
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.115s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Took 19.17 seconds to build instance.
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422328.933657, 68cb788e-be1f-44fc-b65e-b908a5831ae2 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] VM Started (Lifecycle Event)
Apr 13 21:45:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.384s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422329.325851, f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] VM Resumed (Lifecycle Event)
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Took 20.41 seconds to spawn the instance on the hypervisor.
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422329.329713, f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] VM Started (Lifecycle Event)
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:30 user nova-compute[71325]: INFO nova.compute.manager [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Took 21.41 seconds to build instance.
Apr 13 21:45:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.689s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422330.4343991, 3a8e8627-03d4-4a17-a324-93def1017101 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:30 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] VM Resumed (Lifecycle Event)
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:45:30 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Instance spawned successfully.
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:30 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422330.4356997, 3a8e8627-03d4-4a17-a324-93def1017101 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:30 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] VM Started (Lifecycle Event)
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:30 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:30 user nova-compute[71325]: INFO nova.compute.manager [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Took 15.32 seconds to spawn the instance on the hypervisor.
Apr 13 21:45:30 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:30 user nova-compute[71325]: INFO nova.compute.manager [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Took 16.17 seconds to build instance.
Apr 13 21:45:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "3a8e8627-03d4-4a17-a324-93def1017101" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.327s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-a5db2b3f-9b6b-4979-8831-e253fe59e160 req-6c9ad0dd-0257-4002-9c47-ab1a8ffb8dd6 service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a5db2b3f-9b6b-4979-8831-e253fe59e160 req-6c9ad0dd-0257-4002-9c47-ab1a8ffb8dd6 service nova] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a5db2b3f-9b6b-4979-8831-e253fe59e160 req-6c9ad0dd-0257-4002-9c47-ab1a8ffb8dd6 service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a5db2b3f-9b6b-4979-8831-e253fe59e160 req-6c9ad0dd-0257-4002-9c47-ab1a8ffb8dd6 service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-a5db2b3f-9b6b-4979-8831-e253fe59e160 req-6c9ad0dd-0257-4002-9c47-ab1a8ffb8dd6 service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] No waiting events found dispatching network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:34 user nova-compute[71325]: WARNING nova.compute.manager [req-a5db2b3f-9b6b-4979-8831-e253fe59e160 req-6c9ad0dd-0257-4002-9c47-ab1a8ffb8dd6 service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received unexpected event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 for instance with vm_state building and task_state spawning.
Apr 13 21:45:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] No waiting events found dispatching network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:36 user nova-compute[71325]: WARNING nova.compute.manager [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received unexpected event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 for instance with vm_state building and task_state spawning.
Apr 13 21:45:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] No waiting events found dispatching network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:36 user nova-compute[71325]: WARNING nova.compute.manager [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received unexpected event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed for instance with vm_state building and task_state spawning.
Apr 13 21:45:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:36 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422336.994262, eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:36 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] VM Resumed (Lifecycle Event)
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:37 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Instance spawned successfully.
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:37 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422336.9943857, eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:37 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] VM Started (Lifecycle Event)
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:37 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422337.164713, af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:37 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] VM Resumed (Lifecycle Event)
Apr 13 21:45:37 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Instance spawned successfully.
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:37 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422337.170346, af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:37 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] VM Started (Lifecycle Event)
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:37 user nova-compute[71325]: INFO nova.compute.manager [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Took 19.32 seconds to spawn the instance on the hypervisor.
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:37 user nova-compute[71325]: INFO nova.compute.manager [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Took 17.33 seconds to spawn the instance on the hypervisor.
Apr 13 21:45:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:37 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:37 user nova-compute[71325]: INFO nova.compute.manager [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Took 20.31 seconds to build instance.
Apr 13 21:45:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.540s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:37 user nova-compute[71325]: INFO nova.compute.manager [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Took 18.34 seconds to build instance.
Apr 13 21:45:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.516s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-822c0990-6510-456a-bf60-67d23b2e05e7 req-d6d1d5e4-2a1a-4967-a437-2081a3c654ff service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-822c0990-6510-456a-bf60-67d23b2e05e7 req-d6d1d5e4-2a1a-4967-a437-2081a3c654ff service nova] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-822c0990-6510-456a-bf60-67d23b2e05e7 req-d6d1d5e4-2a1a-4967-a437-2081a3c654ff service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-822c0990-6510-456a-bf60-67d23b2e05e7 req-d6d1d5e4-2a1a-4967-a437-2081a3c654ff service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-822c0990-6510-456a-bf60-67d23b2e05e7 req-d6d1d5e4-2a1a-4967-a437-2081a3c654ff service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] No waiting events found dispatching network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:38 user nova-compute[71325]: WARNING nova.compute.manager [req-822c0990-6510-456a-bf60-67d23b2e05e7 req-d6d1d5e4-2a1a-4967-a437-2081a3c654ff service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received unexpected event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed for instance with vm_state active and task_state None.
Apr 13 21:45:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "35820c1d-307d-43ed-b3d1-31fe12602870" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "35820c1d-307d-43ed-b3d1-31fe12602870" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:41 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:45:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:41 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:45:41 user nova-compute[71325]: INFO nova.compute.claims [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Claim successful on node user
Apr 13 21:45:42 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:45:42 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:45:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.878s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:45:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:45:42 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:45:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:45:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:45:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:45:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:45:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Creating image(s)
Apr 13 21:45:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "/opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "/opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "/opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:42 user nova-compute[71325]: DEBUG nova.policy [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5b255efcd6b4033ba11cc64eb376a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8cec16877149a6824b9292c1065c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:45:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.381s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.311s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk 1073741824" returned: 0 in 0.222s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.562s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.259s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "be81f393-654b-4b50-856e-00818f3ae59e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "be81f393-654b-4b50-856e-00818f3ae59e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Cannot resize image /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG nova.objects.instance [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lazy-loading 'migration_context' on Instance uuid 35820c1d-307d-43ed-b3d1-31fe12602870 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Ensure instance console log exists: /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:45:44 user nova-compute[71325]: INFO nova.compute.claims [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Claim successful on node user
Apr 13 21:45:44 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Successfully created port: 015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:45:45 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:45:45 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:45:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.822s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:45:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:45:45 user nova-compute[71325]: DEBUG nova.network.neutron [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:45:45 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:45:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG nova.compute.manager [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:45:46 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Creating image(s)
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "/opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "/opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "/opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.054s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG nova.policy [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97e87956414a49c4b3c34e51fe6ed2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a67a9a0d514f19b6cc0b39477a1b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.175s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.185s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "c71cb46d-2737-4b94-8159-267ea4a0a296" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk 1073741824" returned: 0 in 0.061s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Successfully updated port: 015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "refresh_cache-35820c1d-307d-43ed-b3d1-31fe12602870" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquired lock "refresh_cache-35820c1d-307d-43ed-b3d1-31fe12602870" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-9f9b172d-6ee6-41b8-b34b-fb3603475bb9 req-46740210-e896-4283-8039-f1d1f7a2f4ab service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Received event network-changed-015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-9f9b172d-6ee6-41b8-b34b-fb3603475bb9 req-46740210-e896-4283-8039-f1d1f7a2f4ab service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Refreshing instance network info cache due to event network-changed-015b54d3-245f-448a-b918-e53aaeed180f. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9f9b172d-6ee6-41b8-b34b-fb3603475bb9 req-46740210-e896-4283-8039-f1d1f7a2f4ab service nova] Acquiring lock "refresh_cache-35820c1d-307d-43ed-b3d1-31fe12602870" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.222s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:45:46 user nova-compute[71325]: INFO nova.compute.claims [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Claim successful on node user
Apr 13 21:45:46 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Cannot resize image /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.objects.instance [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lazy-loading 'migration_context' on Instance uuid be81f393-654b-4b50-856e-00818f3ae59e {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Ensure instance console log exists: /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Updating instance_info_cache with network_info: [{"id": "015b54d3-245f-448a-b918-e53aaeed180f", "address": "fa:16:3e:fa:b5:73", "network": {"id": "2c235eb0-e303-4d17-a1d6-b2a05c1adeb5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1743492804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8cec16877149a6824b9292c1065c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b54d3-24", "ovs_interfaceid": "015b54d3-245f-448a-b918-e53aaeed180f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Releasing lock "refresh_cache-35820c1d-307d-43ed-b3d1-31fe12602870" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Instance network_info: |[{"id": "015b54d3-245f-448a-b918-e53aaeed180f", "address": "fa:16:3e:fa:b5:73", "network": {"id": "2c235eb0-e303-4d17-a1d6-b2a05c1adeb5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1743492804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8cec16877149a6824b9292c1065c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b54d3-24", "ovs_interfaceid": "015b54d3-245f-448a-b918-e53aaeed180f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9f9b172d-6ee6-41b8-b34b-fb3603475bb9 req-46740210-e896-4283-8039-f1d1f7a2f4ab service nova] Acquired lock "refresh_cache-35820c1d-307d-43ed-b3d1-31fe12602870" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.network.neutron [req-9f9b172d-6ee6-41b8-b34b-fb3603475bb9 req-46740210-e896-4283-8039-f1d1f7a2f4ab service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Refreshing network info cache for port 015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Start _get_guest_xml network_info=[{"id": "015b54d3-245f-448a-b918-e53aaeed180f", "address": "fa:16:3e:fa:b5:73", "network": {"id": "2c235eb0-e303-4d17-a1d6-b2a05c1adeb5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1743492804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8cec16877149a6824b9292c1065c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b54d3-24", "ovs_interfaceid": "015b54d3-245f-448a-b918-e53aaeed180f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:45:47 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:47 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1884922287',display_name='tempest-TestVolumeSwap-server-1884922287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1884922287',id=8,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWC+Lq7pJ4WDwThJOzr5RF5FYGRTvTjYRBB7k91qrhwtm+D5lvNsjF+j5p20b80DTf/2gxHyYmsifkpGYyU2u3wq7jDQvSYZvn/fEGzUyBeRiZKX/bAu5xuVFp32HZsXw==',key_name='tempest-keypair-1807131148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec8cec16877149a6824b9292c1065c13',ramdisk_id='',reservation_id='r-vbezl4f1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1367203583',owner_user_name='tempest-TestVolumeSwap-1367203583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5b255efcd6b4033ba11cc64eb376a89',uuid=35820c1d-307d-43ed-b3d1-31fe12602870,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "015b54d3-245f-448a-b918-e53aaeed180f", "address": "fa:16:3e:fa:b5:73", "network": {"id": "2c235eb0-e303-4d17-a1d6-b2a05c1adeb5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1743492804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8cec16877149a6824b9292c1065c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b54d3-24", "ovs_interfaceid": "015b54d3-245f-448a-b918-e53aaeed180f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Converting VIF {"id": "015b54d3-245f-448a-b918-e53aaeed180f", "address": "fa:16:3e:fa:b5:73", "network": {"id": "2c235eb0-e303-4d17-a1d6-b2a05c1adeb5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1743492804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8cec16877149a6824b9292c1065c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b54d3-24", "ovs_interfaceid": "015b54d3-245f-448a-b918-e53aaeed180f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:b5:73,bridge_name='br-int',has_traffic_filtering=True,id=015b54d3-245f-448a-b918-e53aaeed180f,network=Network(2c235eb0-e303-4d17-a1d6-b2a05c1adeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b54d3-24') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.objects.instance [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lazy-loading 'pci_devices' on Instance uuid 35820c1d-307d-43ed-b3d1-31fe12602870 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:45:47 user nova-compute[71325]:   <uuid>35820c1d-307d-43ed-b3d1-31fe12602870</uuid>
Apr 13 21:45:47 user nova-compute[71325]:   <name>instance-00000008</name>
Apr 13 21:45:47 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:45:47 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:45:47 user nova-compute[71325]:   <metadata>
Apr 13 21:45:47 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:45:47 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:45:47 user nova-compute[71325]:       <nova:name>tempest-TestVolumeSwap-server-1884922287</nova:name>
Apr 13 21:45:47 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:45:47</nova:creationTime>
Apr 13 21:45:47 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:45:47 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:45:47 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:45:47 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:45:47 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:45:47 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:45:47 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:45:47 user nova-compute[71325]:       <nova:owner>
Apr 13 21:45:47 user nova-compute[71325]:         <nova:user uuid="f5b255efcd6b4033ba11cc64eb376a89">tempest-TestVolumeSwap-1367203583-project-member</nova:user>
Apr 13 21:45:47 user nova-compute[71325]:         <nova:project uuid="ec8cec16877149a6824b9292c1065c13">tempest-TestVolumeSwap-1367203583</nova:project>
Apr 13 21:45:47 user nova-compute[71325]:       </nova:owner>
Apr 13 21:45:47 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:45:47 user nova-compute[71325]:       <nova:ports>
Apr 13 21:45:47 user nova-compute[71325]:         <nova:port uuid="015b54d3-245f-448a-b918-e53aaeed180f">
Apr 13 21:45:47 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 21:45:47 user nova-compute[71325]:         </nova:port>
Apr 13 21:45:47 user nova-compute[71325]:       </nova:ports>
Apr 13 21:45:47 user nova-compute[71325]:     </nova:instance>
Apr 13 21:45:47 user nova-compute[71325]:   </metadata>
Apr 13 21:45:47 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:45:47 user nova-compute[71325]:     <system>
Apr 13 21:45:47 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:45:47 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:45:47 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:45:47 user nova-compute[71325]:       <entry name="serial">35820c1d-307d-43ed-b3d1-31fe12602870</entry>
Apr 13 21:45:47 user nova-compute[71325]:       <entry name="uuid">35820c1d-307d-43ed-b3d1-31fe12602870</entry>
Apr 13 21:45:47 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:45:47 user nova-compute[71325]:     </system>
Apr 13 21:45:47 user nova-compute[71325]:   </sysinfo>
Apr 13 21:45:47 user nova-compute[71325]:   <os>
Apr 13 21:45:47 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:45:47 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:45:47 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:45:47 user nova-compute[71325]:   </os>
Apr 13 21:45:47 user nova-compute[71325]:   <features>
Apr 13 21:45:47 user nova-compute[71325]:     <acpi/>
Apr 13 21:45:47 user nova-compute[71325]:     <apic/>
Apr 13 21:45:47 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:45:47 user nova-compute[71325]:   </features>
Apr 13 21:45:47 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:45:47 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:45:47 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:45:47 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:45:47 user nova-compute[71325]:   </clock>
Apr 13 21:45:47 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:45:47 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:45:47 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:45:47 user nova-compute[71325]:   </cpu>
Apr 13 21:45:47 user nova-compute[71325]:   <devices>
Apr 13 21:45:47 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:45:47 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:45:47 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk"/>
Apr 13 21:45:47 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:45:47 user nova-compute[71325]:     </disk>
Apr 13 21:45:47 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:45:47 user nova-compute[71325]:       <mac address="fa:16:3e:fa:b5:73"/>
Apr 13 21:45:47 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:47 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:45:47 user nova-compute[71325]:       <target dev="tap015b54d3-24"/>
Apr 13 21:45:47 user nova-compute[71325]:     </interface>
Apr 13 21:45:47 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:45:47 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/console.log" append="off"/>
Apr 13 21:45:47 user nova-compute[71325]:     </serial>
Apr 13 21:45:47 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:45:47 user nova-compute[71325]:     <video>
Apr 13 21:45:47 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:47 user nova-compute[71325]:     </video>
Apr 13 21:45:47 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:45:47 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:45:47 user nova-compute[71325]:     </rng>
Apr 13 21:45:47 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:45:47 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:45:47 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:45:47 user nova-compute[71325]:     </memballoon>
Apr 13 21:45:47 user nova-compute[71325]:   </devices>
Apr 13 21:45:47 user nova-compute[71325]: </domain>
Apr 13 21:45:47 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1884922287',display_name='tempest-TestVolumeSwap-server-1884922287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1884922287',id=8,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWC+Lq7pJ4WDwThJOzr5RF5FYGRTvTjYRBB7k91qrhwtm+D5lvNsjF+j5p20b80DTf/2gxHyYmsifkpGYyU2u3wq7jDQvSYZvn/fEGzUyBeRiZKX/bAu5xuVFp32HZsXw==',key_name='tempest-keypair-1807131148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec8cec16877149a6824b9292c1065c13',ramdisk_id='',reservation_id='r-vbezl4f1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1367203583',owner_user_name='tempest-TestVolumeSwap-1367203583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5b255efcd6b4033ba11cc64eb376a89',uuid=35820c1d-307d-43ed-b3d1-31fe12602870,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "015b54d3-245f-448a-b918-e53aaeed180f", "address": "fa:16:3e:fa:b5:73", "network": {"id": "2c235eb0-e303-4d17-a1d6-b2a05c1adeb5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1743492804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8cec16877149a6824b9292c1065c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b54d3-24", "ovs_interfaceid": "015b54d3-245f-448a-b918-e53aaeed180f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Converting VIF {"id": "015b54d3-245f-448a-b918-e53aaeed180f", "address": "fa:16:3e:fa:b5:73", "network": {"id": "2c235eb0-e303-4d17-a1d6-b2a05c1adeb5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1743492804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8cec16877149a6824b9292c1065c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b54d3-24", "ovs_interfaceid": "015b54d3-245f-448a-b918-e53aaeed180f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:b5:73,bridge_name='br-int',has_traffic_filtering=True,id=015b54d3-245f-448a-b918-e53aaeed180f,network=Network(2c235eb0-e303-4d17-a1d6-b2a05c1adeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b54d3-24') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG os_vif [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:b5:73,bridge_name='br-int',has_traffic_filtering=True,id=015b54d3-245f-448a-b918-e53aaeed180f,network=Network(2c235eb0-e303-4d17-a1d6-b2a05c1adeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b54d3-24') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap015b54d3-24, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap015b54d3-24, col_values=(('external_ids', {'iface-id': '015b54d3-245f-448a-b918-e53aaeed180f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:b5:73', 'vm-uuid': '35820c1d-307d-43ed-b3d1-31fe12602870'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:45:47 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 13 21:45:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:47 user nova-compute[71325]: INFO os_vif [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:b5:73,bridge_name='br-int',has_traffic_filtering=True,id=015b54d3-245f-448a-b918-e53aaeed180f,network=Network(2c235eb0-e303-4d17-a1d6-b2a05c1adeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b54d3-24')
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.network.neutron [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Successfully created port: c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:45:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] No VIF found with MAC fa:16:3e:fa:b5:73, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:45:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:45:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:45:48 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Creating image(s)
Apr 13 21:45:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "/opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "/opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "/opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "526107132027802e37365c9d43ef160ef48b16a0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "526107132027802e37365c9d43ef160ef48b16a0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:48 user nova-compute[71325]: DEBUG nova.policy [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acd1c71dac2c4f2a810c2f4a6883fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddcd2da3f5e4a148bef3c7c4adce6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:45:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0.part --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0.part --force-share --output=json" returned: 0 in 0.172s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:48 user nova-compute[71325]: DEBUG nova.virt.images [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] dda98d66-c12c-4e6c-8424-49468954423b was qcow2, converting to raw {{(pid=71325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 21:45:48 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:45:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0.part /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0.converted {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG nova.network.neutron [req-9f9b172d-6ee6-41b8-b34b-fb3603475bb9 req-46740210-e896-4283-8039-f1d1f7a2f4ab service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Updated VIF entry in instance network info cache for port 015b54d3-245f-448a-b918-e53aaeed180f. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG nova.network.neutron [req-9f9b172d-6ee6-41b8-b34b-fb3603475bb9 req-46740210-e896-4283-8039-f1d1f7a2f4ab service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Updating instance_info_cache with network_info: [{"id": "015b54d3-245f-448a-b918-e53aaeed180f", "address": "fa:16:3e:fa:b5:73", "network": {"id": "2c235eb0-e303-4d17-a1d6-b2a05c1adeb5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1743492804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8cec16877149a6824b9292c1065c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b54d3-24", "ovs_interfaceid": "015b54d3-245f-448a-b918-e53aaeed180f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9f9b172d-6ee6-41b8-b34b-fb3603475bb9 req-46740210-e896-4283-8039-f1d1f7a2f4ab service nova] Releasing lock "refresh_cache-35820c1d-307d-43ed-b3d1-31fe12602870" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0.part /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0.converted" returned: 0 in 0.356s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0.converted --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG nova.network.neutron [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Successfully updated port: c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "refresh_cache-be81f393-654b-4b50-856e-00818f3ae59e" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquired lock "refresh_cache-be81f393-654b-4b50-856e-00818f3ae59e" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG nova.network.neutron [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-3d8a5bb1-4404-427c-be10-f47f0905fa1c req-1c0d1993-0c41-4a23-935b-ce8341237966 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Received event network-changed-c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-3d8a5bb1-4404-427c-be10-f47f0905fa1c req-1c0d1993-0c41-4a23-935b-ce8341237966 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Refreshing instance network info cache due to event network-changed-c0b475f1-01a2-4492-ac88-67f44080f771. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3d8a5bb1-4404-427c-be10-f47f0905fa1c req-1c0d1993-0c41-4a23-935b-ce8341237966 service nova] Acquiring lock "refresh_cache-be81f393-654b-4b50-856e-00818f3ae59e" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG nova.network.neutron [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "526107132027802e37365c9d43ef160ef48b16a0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.320s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0 --force-share --output=json" returned: 0 in 0.230s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "526107132027802e37365c9d43ef160ef48b16a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "526107132027802e37365c9d43ef160ef48b16a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Successfully created port: 3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0 --force-share --output=json" returned: 0 in 0.276s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0,backing_fmt=raw /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG nova.network.neutron [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Updating instance_info_cache with network_info: [{"id": "c0b475f1-01a2-4492-ac88-67f44080f771", "address": "fa:16:3e:02:59:10", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0b475f1-01", "ovs_interfaceid": "c0b475f1-01a2-4492-ac88-67f44080f771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0,backing_fmt=raw /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk 1073741824" returned: 0 in 0.077s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "526107132027802e37365c9d43ef160ef48b16a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.372s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Releasing lock "refresh_cache-be81f393-654b-4b50-856e-00818f3ae59e" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Instance network_info: |[{"id": "c0b475f1-01a2-4492-ac88-67f44080f771", "address": "fa:16:3e:02:59:10", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0b475f1-01", "ovs_interfaceid": "c0b475f1-01a2-4492-ac88-67f44080f771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3d8a5bb1-4404-427c-be10-f47f0905fa1c req-1c0d1993-0c41-4a23-935b-ce8341237966 service nova] Acquired lock "refresh_cache-be81f393-654b-4b50-856e-00818f3ae59e" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.network.neutron [req-3d8a5bb1-4404-427c-be10-f47f0905fa1c req-1c0d1993-0c41-4a23-935b-ce8341237966 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Refreshing network info cache for port c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Start _get_guest_xml network_info=[{"id": "c0b475f1-01a2-4492-ac88-67f44080f771", "address": "fa:16:3e:02:59:10", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0b475f1-01", "ovs_interfaceid": "c0b475f1-01a2-4492-ac88-67f44080f771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:45:50 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:50 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-452847607',display_name='tempest-VolumesAdminNegativeTest-server-452847607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-452847607',id=9,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOVPDIms8lGQmxW0b6d+PIMb94QdlHp7hlh+Q/5jFinTckEYdyLh00UbgoM7ROLffK93N7l3ulRDVVB1s0zuiy0lE4iXR7lWtCVRO2tXqkvRZAl7MFNGrmKz7BzYb2Gyw==',key_name='tempest-keypair-1995468323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03a67a9a0d514f19b6cc0b39477a1b42',ramdisk_id='',reservation_id='r-ydrglqo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1461294072',owner_user_name='tempest-VolumesAdminNegativeTest-1461294072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e87956414a49c4b3c34e51fe6ed2ec',uuid=be81f393-654b-4b50-856e-00818f3ae59e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0b475f1-01a2-4492-ac88-67f44080f771", "address": "fa:16:3e:02:59:10", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0b475f1-01", "ovs_interfaceid": "c0b475f1-01a2-4492-ac88-67f44080f771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Converting VIF {"id": "c0b475f1-01a2-4492-ac88-67f44080f771", "address": "fa:16:3e:02:59:10", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0b475f1-01", "ovs_interfaceid": "c0b475f1-01a2-4492-ac88-67f44080f771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:59:10,bridge_name='br-int',has_traffic_filtering=True,id=c0b475f1-01a2-4492-ac88-67f44080f771,network=Network(25a51e04-88d5-45b8-865b-f2c7da7460b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0b475f1-01') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.objects.instance [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lazy-loading 'pci_devices' on Instance uuid be81f393-654b-4b50-856e-00818f3ae59e {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0 --force-share --output=json" returned: 0 in 0.170s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:45:50 user nova-compute[71325]:   <uuid>be81f393-654b-4b50-856e-00818f3ae59e</uuid>
Apr 13 21:45:50 user nova-compute[71325]:   <name>instance-00000009</name>
Apr 13 21:45:50 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:45:50 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:45:50 user nova-compute[71325]:   <metadata>
Apr 13 21:45:50 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:45:50 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:45:50 user nova-compute[71325]:       <nova:name>tempest-VolumesAdminNegativeTest-server-452847607</nova:name>
Apr 13 21:45:50 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:45:50</nova:creationTime>
Apr 13 21:45:50 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:45:50 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:45:50 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:45:50 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:45:50 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:45:50 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:45:50 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:45:50 user nova-compute[71325]:       <nova:owner>
Apr 13 21:45:50 user nova-compute[71325]:         <nova:user uuid="97e87956414a49c4b3c34e51fe6ed2ec">tempest-VolumesAdminNegativeTest-1461294072-project-member</nova:user>
Apr 13 21:45:50 user nova-compute[71325]:         <nova:project uuid="03a67a9a0d514f19b6cc0b39477a1b42">tempest-VolumesAdminNegativeTest-1461294072</nova:project>
Apr 13 21:45:50 user nova-compute[71325]:       </nova:owner>
Apr 13 21:45:50 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:45:50 user nova-compute[71325]:       <nova:ports>
Apr 13 21:45:50 user nova-compute[71325]:         <nova:port uuid="c0b475f1-01a2-4492-ac88-67f44080f771">
Apr 13 21:45:50 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 21:45:50 user nova-compute[71325]:         </nova:port>
Apr 13 21:45:50 user nova-compute[71325]:       </nova:ports>
Apr 13 21:45:50 user nova-compute[71325]:     </nova:instance>
Apr 13 21:45:50 user nova-compute[71325]:   </metadata>
Apr 13 21:45:50 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:45:50 user nova-compute[71325]:     <system>
Apr 13 21:45:50 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:45:50 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:45:50 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:45:50 user nova-compute[71325]:       <entry name="serial">be81f393-654b-4b50-856e-00818f3ae59e</entry>
Apr 13 21:45:50 user nova-compute[71325]:       <entry name="uuid">be81f393-654b-4b50-856e-00818f3ae59e</entry>
Apr 13 21:45:50 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:45:50 user nova-compute[71325]:     </system>
Apr 13 21:45:50 user nova-compute[71325]:   </sysinfo>
Apr 13 21:45:50 user nova-compute[71325]:   <os>
Apr 13 21:45:50 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:45:50 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:45:50 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:45:50 user nova-compute[71325]:   </os>
Apr 13 21:45:50 user nova-compute[71325]:   <features>
Apr 13 21:45:50 user nova-compute[71325]:     <acpi/>
Apr 13 21:45:50 user nova-compute[71325]:     <apic/>
Apr 13 21:45:50 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:45:50 user nova-compute[71325]:   </features>
Apr 13 21:45:50 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:45:50 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:45:50 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:45:50 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:45:50 user nova-compute[71325]:   </clock>
Apr 13 21:45:50 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:45:50 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:45:50 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:45:50 user nova-compute[71325]:   </cpu>
Apr 13 21:45:50 user nova-compute[71325]:   <devices>
Apr 13 21:45:50 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:45:50 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:45:50 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk"/>
Apr 13 21:45:50 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:45:50 user nova-compute[71325]:     </disk>
Apr 13 21:45:50 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:45:50 user nova-compute[71325]:       <mac address="fa:16:3e:02:59:10"/>
Apr 13 21:45:50 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:50 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:45:50 user nova-compute[71325]:       <target dev="tapc0b475f1-01"/>
Apr 13 21:45:50 user nova-compute[71325]:     </interface>
Apr 13 21:45:50 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:45:50 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/console.log" append="off"/>
Apr 13 21:45:50 user nova-compute[71325]:     </serial>
Apr 13 21:45:50 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:45:50 user nova-compute[71325]:     <video>
Apr 13 21:45:50 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:50 user nova-compute[71325]:     </video>
Apr 13 21:45:50 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:45:50 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:45:50 user nova-compute[71325]:     </rng>
Apr 13 21:45:50 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:45:50 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:45:50 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:45:50 user nova-compute[71325]:     </memballoon>
Apr 13 21:45:50 user nova-compute[71325]:   </devices>
Apr 13 21:45:50 user nova-compute[71325]: </domain>
Apr 13 21:45:50 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-452847607',display_name='tempest-VolumesAdminNegativeTest-server-452847607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-452847607',id=9,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOVPDIms8lGQmxW0b6d+PIMb94QdlHp7hlh+Q/5jFinTckEYdyLh00UbgoM7ROLffK93N7l3ulRDVVB1s0zuiy0lE4iXR7lWtCVRO2tXqkvRZAl7MFNGrmKz7BzYb2Gyw==',key_name='tempest-keypair-1995468323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03a67a9a0d514f19b6cc0b39477a1b42',ramdisk_id='',reservation_id='r-ydrglqo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1461294072',owner_user_name='tempest-VolumesAdminNegativeTest-1461294072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e87956414a49c4b3c34e51fe6ed2ec',uuid=be81f393-654b-4b50-856e-00818f3ae59e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0b475f1-01a2-4492-ac88-67f44080f771", "address": "fa:16:3e:02:59:10", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0b475f1-01", "ovs_interfaceid": "c0b475f1-01a2-4492-ac88-67f44080f771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Converting VIF {"id": "c0b475f1-01a2-4492-ac88-67f44080f771", "address": "fa:16:3e:02:59:10", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0b475f1-01", "ovs_interfaceid": "c0b475f1-01a2-4492-ac88-67f44080f771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:59:10,bridge_name='br-int',has_traffic_filtering=True,id=c0b475f1-01a2-4492-ac88-67f44080f771,network=Network(25a51e04-88d5-45b8-865b-f2c7da7460b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0b475f1-01') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG os_vif [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:59:10,bridge_name='br-int',has_traffic_filtering=True,id=c0b475f1-01a2-4492-ac88-67f44080f771,network=Network(25a51e04-88d5-45b8-865b-f2c7da7460b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0b475f1-01') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0b475f1-01, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0b475f1-01, col_values=(('external_ids', {'iface-id': 'c0b475f1-01a2-4492-ac88-67f44080f771', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:59:10', 'vm-uuid': 'be81f393-654b-4b50-856e-00818f3ae59e'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:50 user nova-compute[71325]: INFO os_vif [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:59:10,bridge_name='br-int',has_traffic_filtering=True,id=c0b475f1-01a2-4492-ac88-67f44080f771,network=Network(25a51e04-88d5-45b8-865b-f2c7da7460b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0b475f1-01')
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] No VIF found with MAC fa:16:3e:02:59:10, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Cannot resize image /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.objects.instance [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lazy-loading 'migration_context' on Instance uuid c71cb46d-2737-4b94-8159-267ea4a0a296 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Ensure instance console log exists: /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.network.neutron [req-3d8a5bb1-4404-427c-be10-f47f0905fa1c req-1c0d1993-0c41-4a23-935b-ce8341237966 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Updated VIF entry in instance network info cache for port c0b475f1-01a2-4492-ac88-67f44080f771. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG nova.network.neutron [req-3d8a5bb1-4404-427c-be10-f47f0905fa1c req-1c0d1993-0c41-4a23-935b-ce8341237966 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Updating instance_info_cache with network_info: [{"id": "c0b475f1-01a2-4492-ac88-67f44080f771", "address": "fa:16:3e:02:59:10", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0b475f1-01", "ovs_interfaceid": "c0b475f1-01a2-4492-ac88-67f44080f771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3d8a5bb1-4404-427c-be10-f47f0905fa1c req-1c0d1993-0c41-4a23-935b-ce8341237966 service nova] Releasing lock "refresh_cache-be81f393-654b-4b50-856e-00818f3ae59e" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Successfully updated port: 3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "refresh_cache-c71cb46d-2737-4b94-8159-267ea4a0a296" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquired lock "refresh_cache-c71cb46d-2737-4b94-8159-267ea4a0a296" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-cc97d355-3716-4008-9341-6d3918b5ddd8 req-fb5a4866-1932-49c7-98c8-9df37e73c5dd service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Received event network-changed-3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-cc97d355-3716-4008-9341-6d3918b5ddd8 req-fb5a4866-1932-49c7-98c8-9df37e73c5dd service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Refreshing instance network info cache due to event network-changed-3a5a1230-3352-4342-80b2-5c87991a9b3d. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-cc97d355-3716-4008-9341-6d3918b5ddd8 req-fb5a4866-1932-49c7-98c8-9df37e73c5dd service nova] Acquiring lock "refresh_cache-c71cb46d-2737-4b94-8159-267ea4a0a296" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Received event network-vif-plugged-015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] Acquiring lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] Lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] Lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] No waiting events found dispatching network-vif-plugged-015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:51 user nova-compute[71325]: WARNING nova.compute.manager [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Received unexpected event network-vif-plugged-015b54d3-245f-448a-b918-e53aaeed180f for instance with vm_state building and task_state spawning.
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Received event network-vif-plugged-015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] Acquiring lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] Lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] Lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] No waiting events found dispatching network-vif-plugged-015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:51 user nova-compute[71325]: WARNING nova.compute.manager [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Received unexpected event network-vif-plugged-015b54d3-245f-448a-b918-e53aaeed180f for instance with vm_state building and task_state spawning.
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Updating instance_info_cache with network_info: [{"id": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "address": "fa:16:3e:70:87:1e", "network": {"id": "b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1362663481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddcd2da3f5e4a148bef3c7c4adce6db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5a1230-33", "ovs_interfaceid": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Releasing lock "refresh_cache-c71cb46d-2737-4b94-8159-267ea4a0a296" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Instance network_info: |[{"id": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "address": "fa:16:3e:70:87:1e", "network": {"id": "b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1362663481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddcd2da3f5e4a148bef3c7c4adce6db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5a1230-33", "ovs_interfaceid": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-cc97d355-3716-4008-9341-6d3918b5ddd8 req-fb5a4866-1932-49c7-98c8-9df37e73c5dd service nova] Acquired lock "refresh_cache-c71cb46d-2737-4b94-8159-267ea4a0a296" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.network.neutron [req-cc97d355-3716-4008-9341-6d3918b5ddd8 req-fb5a4866-1932-49c7-98c8-9df37e73c5dd service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Refreshing network info cache for port 3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Start _get_guest_xml network_info=[{"id": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "address": "fa:16:3e:70:87:1e", "network": {"id": "b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1362663481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddcd2da3f5e4a148bef3c7c4adce6db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5a1230-33", "ovs_interfaceid": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:45:36Z,direct_url=<?>,disk_format='qcow2',id=dda98d66-c12c-4e6c-8424-49468954423b,min_disk=0,min_ram=0,name='',owner='3a61e0693d3e4949892704e29f20a6b5',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:45:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/sda', 'guest_format': None, 'image_id': 'dda98d66-c12c-4e6c-8424-49468954423b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:45:51 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:51 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:45:36Z,direct_url=<?>,disk_format='qcow2',id=dda98d66-c12c-4e6c-8424-49468954423b,min_disk=0,min_ram=0,name='',owner='3a61e0693d3e4949892704e29f20a6b5',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:45:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:45:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1482021877',display_name='tempest-AttachSCSIVolumeTestJSON-server-1482021877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1482021877',id=10,image_ref='dda98d66-c12c-4e6c-8424-49468954423b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFROVO+zm7q7MfconxyMxDki9e01Easmw29VJ/VqS+XvT8Z0ODRB772cwRCD/oqQmD8w9y32x+8FkKd6/URareT0Tt2jFEa6d7Cczm3AP49Fa7ACviOhVHEiiknpYk8Ig==',key_name='tempest-keypair-370819211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ddcd2da3f5e4a148bef3c7c4adce6db',ramdisk_id='',reservation_id='r-izjeaxxx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dda98d66-c12c-4e6c-8424-49468954423b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-499777998',owner_user_name='tempest-AttachSCSIVolumeTestJSON-499777998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acd1c71dac2c4f2a810c2f4a6883fde9',uuid=c71cb46d-2737-4b94-8159-267ea4a0a296,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "address": "fa:16:3e:70:87:1e", "network": {"id": "b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1362663481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddcd2da3f5e4a148bef3c7c4adce6db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5a1230-33", "ovs_interfaceid": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Converting VIF {"id": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "address": "fa:16:3e:70:87:1e", "network": {"id": "b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1362663481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddcd2da3f5e4a148bef3c7c4adce6db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5a1230-33", "ovs_interfaceid": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:87:1e,bridge_name='br-int',has_traffic_filtering=True,id=3a5a1230-3352-4342-80b2-5c87991a9b3d,network=Network(b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5a1230-33') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.objects.instance [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lazy-loading 'pci_devices' on Instance uuid c71cb46d-2737-4b94-8159-267ea4a0a296 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:45:51 user nova-compute[71325]:   <uuid>c71cb46d-2737-4b94-8159-267ea4a0a296</uuid>
Apr 13 21:45:51 user nova-compute[71325]:   <name>instance-0000000a</name>
Apr 13 21:45:51 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:45:51 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:45:51 user nova-compute[71325]:   <metadata>
Apr 13 21:45:51 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:45:51 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:45:51 user nova-compute[71325]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1482021877</nova:name>
Apr 13 21:45:51 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:45:51</nova:creationTime>
Apr 13 21:45:51 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:45:51 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:45:51 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:45:51 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:45:51 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:45:51 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:45:51 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:45:51 user nova-compute[71325]:       <nova:owner>
Apr 13 21:45:51 user nova-compute[71325]:         <nova:user uuid="acd1c71dac2c4f2a810c2f4a6883fde9">tempest-AttachSCSIVolumeTestJSON-499777998-project-member</nova:user>
Apr 13 21:45:51 user nova-compute[71325]:         <nova:project uuid="6ddcd2da3f5e4a148bef3c7c4adce6db">tempest-AttachSCSIVolumeTestJSON-499777998</nova:project>
Apr 13 21:45:51 user nova-compute[71325]:       </nova:owner>
Apr 13 21:45:51 user nova-compute[71325]:       <nova:root type="image" uuid="dda98d66-c12c-4e6c-8424-49468954423b"/>
Apr 13 21:45:51 user nova-compute[71325]:       <nova:ports>
Apr 13 21:45:51 user nova-compute[71325]:         <nova:port uuid="3a5a1230-3352-4342-80b2-5c87991a9b3d">
Apr 13 21:45:51 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 21:45:51 user nova-compute[71325]:         </nova:port>
Apr 13 21:45:51 user nova-compute[71325]:       </nova:ports>
Apr 13 21:45:51 user nova-compute[71325]:     </nova:instance>
Apr 13 21:45:51 user nova-compute[71325]:   </metadata>
Apr 13 21:45:51 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:45:51 user nova-compute[71325]:     <system>
Apr 13 21:45:51 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:45:51 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:45:51 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:45:51 user nova-compute[71325]:       <entry name="serial">c71cb46d-2737-4b94-8159-267ea4a0a296</entry>
Apr 13 21:45:51 user nova-compute[71325]:       <entry name="uuid">c71cb46d-2737-4b94-8159-267ea4a0a296</entry>
Apr 13 21:45:51 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:45:51 user nova-compute[71325]:     </system>
Apr 13 21:45:51 user nova-compute[71325]:   </sysinfo>
Apr 13 21:45:51 user nova-compute[71325]:   <os>
Apr 13 21:45:51 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:45:51 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:45:51 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:45:51 user nova-compute[71325]:   </os>
Apr 13 21:45:51 user nova-compute[71325]:   <features>
Apr 13 21:45:51 user nova-compute[71325]:     <acpi/>
Apr 13 21:45:51 user nova-compute[71325]:     <apic/>
Apr 13 21:45:51 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:45:51 user nova-compute[71325]:   </features>
Apr 13 21:45:51 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:45:51 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:45:51 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:45:51 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:45:51 user nova-compute[71325]:   </clock>
Apr 13 21:45:51 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:45:51 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:45:51 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:45:51 user nova-compute[71325]:   </cpu>
Apr 13 21:45:51 user nova-compute[71325]:   <devices>
Apr 13 21:45:51 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:45:51 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:45:51 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk"/>
Apr 13 21:45:51 user nova-compute[71325]:       <target dev="sda" bus="scsi"/>
Apr 13 21:45:51 user nova-compute[71325]:       <address type="drive" controller="0" unit="0"/>
Apr 13 21:45:51 user nova-compute[71325]:     </disk>
Apr 13 21:45:51 user nova-compute[71325]:     <disk type="file" device="cdrom">
Apr 13 21:45:51 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 21:45:51 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk.config"/>
Apr 13 21:45:51 user nova-compute[71325]:       <target dev="sdb" bus="scsi"/>
Apr 13 21:45:51 user nova-compute[71325]:       <address type="drive" controller="0" unit="1"/>
Apr 13 21:45:51 user nova-compute[71325]:     </disk>
Apr 13 21:45:51 user nova-compute[71325]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 13 21:45:51 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:45:51 user nova-compute[71325]:       <mac address="fa:16:3e:70:87:1e"/>
Apr 13 21:45:51 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:51 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:45:51 user nova-compute[71325]:       <target dev="tap3a5a1230-33"/>
Apr 13 21:45:51 user nova-compute[71325]:     </interface>
Apr 13 21:45:51 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:45:51 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/console.log" append="off"/>
Apr 13 21:45:51 user nova-compute[71325]:     </serial>
Apr 13 21:45:51 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:45:51 user nova-compute[71325]:     <video>
Apr 13 21:45:51 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:51 user nova-compute[71325]:     </video>
Apr 13 21:45:51 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:45:51 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:45:51 user nova-compute[71325]:     </rng>
Apr 13 21:45:51 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:45:51 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:45:51 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:45:51 user nova-compute[71325]:     </memballoon>
Apr 13 21:45:51 user nova-compute[71325]:   </devices>
Apr 13 21:45:51 user nova-compute[71325]: </domain>
Apr 13 21:45:51 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:45:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1482021877',display_name='tempest-AttachSCSIVolumeTestJSON-server-1482021877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1482021877',id=10,image_ref='dda98d66-c12c-4e6c-8424-49468954423b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFROVO+zm7q7MfconxyMxDki9e01Easmw29VJ/VqS+XvT8Z0ODRB772cwRCD/oqQmD8w9y32x+8FkKd6/URareT0Tt2jFEa6d7Cczm3AP49Fa7ACviOhVHEiiknpYk8Ig==',key_name='tempest-keypair-370819211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ddcd2da3f5e4a148bef3c7c4adce6db',ramdisk_id='',reservation_id='r-izjeaxxx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dda98d66-c12c-4e6c-8424-49468954423b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-499777998',owner_user_name='tempest-AttachSCSIVolumeTestJSON-499777998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acd1c71dac2c4f2a810c2f4a6883fde9',uuid=c71cb46d-2737-4b94-8159-267ea4a0a296,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "address": "fa:16:3e:70:87:1e", "network": {"id": "b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1362663481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddcd2da3f5e4a148bef3c7c4adce6db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5a1230-33", "ovs_interfaceid": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Converting VIF {"id": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "address": "fa:16:3e:70:87:1e", "network": {"id": "b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1362663481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddcd2da3f5e4a148bef3c7c4adce6db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5a1230-33", "ovs_interfaceid": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:87:1e,bridge_name='br-int',has_traffic_filtering=True,id=3a5a1230-3352-4342-80b2-5c87991a9b3d,network=Network(b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5a1230-33') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG os_vif [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:87:1e,bridge_name='br-int',has_traffic_filtering=True,id=3a5a1230-3352-4342-80b2-5c87991a9b3d,network=Network(b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5a1230-33') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a5a1230-33, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a5a1230-33, col_values=(('external_ids', {'iface-id': '3a5a1230-3352-4342-80b2-5c87991a9b3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:87:1e', 'vm-uuid': 'c71cb46d-2737-4b94-8159-267ea4a0a296'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:51 user nova-compute[71325]: INFO os_vif [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:87:1e,bridge_name='br-int',has_traffic_filtering=True,id=3a5a1230-3352-4342-80b2-5c87991a9b3d,network=Network(b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5a1230-33')
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] No BDM found with device name sda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] No VIF found with MAC fa:16:3e:70:87:1e, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:45:51 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Using config drive
Apr 13 21:45:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422351.959236, 35820c1d-307d-43ed-b3d1-31fe12602870 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:51 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] VM Resumed (Lifecycle Event)
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:45:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Instance spawned successfully.
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422351.9618864, 35820c1d-307d-43ed-b3d1-31fe12602870 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] VM Started (Lifecycle Event)
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:52 user nova-compute[71325]: INFO nova.compute.manager [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Took 9.36 seconds to spawn the instance on the hypervisor.
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:52 user nova-compute[71325]: INFO nova.compute.manager [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Took 10.86 seconds to build instance.
Apr 13 21:45:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Creating config drive at /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk.config
Apr 13 21:45:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn3efio39 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "35820c1d-307d-43ed-b3d1-31fe12602870" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.151s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn3efio39" returned: 0 in 0.100s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "ff61d99e-4db9-421f-8c01-264a7278c095" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "ff61d99e-4db9-421f-8c01-264a7278c095" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:45:52 user nova-compute[71325]: INFO nova.compute.claims [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Claim successful on node user
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.network.neutron [req-cc97d355-3716-4008-9341-6d3918b5ddd8 req-fb5a4866-1932-49c7-98c8-9df37e73c5dd service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Updated VIF entry in instance network info cache for port 3a5a1230-3352-4342-80b2-5c87991a9b3d. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG nova.network.neutron [req-cc97d355-3716-4008-9341-6d3918b5ddd8 req-fb5a4866-1932-49c7-98c8-9df37e73c5dd service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Updating instance_info_cache with network_info: [{"id": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "address": "fa:16:3e:70:87:1e", "network": {"id": "b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1362663481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddcd2da3f5e4a148bef3c7c4adce6db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5a1230-33", "ovs_interfaceid": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-cc97d355-3716-4008-9341-6d3918b5ddd8 req-fb5a4866-1932-49c7-98c8-9df37e73c5dd service nova] Releasing lock "refresh_cache-c71cb46d-2737-4b94-8159-267ea4a0a296" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Received event network-vif-plugged-c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] Acquiring lock "be81f393-654b-4b50-856e-00818f3ae59e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] Lock "be81f393-654b-4b50-856e-00818f3ae59e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] Lock "be81f393-654b-4b50-856e-00818f3ae59e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] No waiting events found dispatching network-vif-plugged-c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:53 user nova-compute[71325]: WARNING nova.compute.manager [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Received unexpected event network-vif-plugged-c0b475f1-01a2-4492-ac88-67f44080f771 for instance with vm_state building and task_state spawning.
Apr 13 21:45:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Received event network-vif-plugged-c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] Acquiring lock "be81f393-654b-4b50-856e-00818f3ae59e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] Lock "be81f393-654b-4b50-856e-00818f3ae59e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] Lock "be81f393-654b-4b50-856e-00818f3ae59e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] No waiting events found dispatching network-vif-plugged-c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:53 user nova-compute[71325]: WARNING nova.compute.manager [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Received unexpected event network-vif-plugged-c0b475f1-01a2-4492-ac88-67f44080f771 for instance with vm_state building and task_state spawning.
Apr 13 21:45:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:45:53 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:45:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG nova.policy [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18587f4671a34f568e00dbee3f33eb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd0897baf2c455c87ac9a330a673d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:45:53 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Creating image(s)
Apr 13 21:45:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "/opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "/opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.192s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.176s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk 1073741824" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-441b46ab-bc16-4ac0-a39d-8b65ff1d1afd req-694224e1-6e12-4305-a91b-acbf9fe5dd29 service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Received event network-vif-plugged-3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-441b46ab-bc16-4ac0-a39d-8b65ff1d1afd req-694224e1-6e12-4305-a91b-acbf9fe5dd29 service nova] Acquiring lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-441b46ab-bc16-4ac0-a39d-8b65ff1d1afd req-694224e1-6e12-4305-a91b-acbf9fe5dd29 service nova] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-441b46ab-bc16-4ac0-a39d-8b65ff1d1afd req-694224e1-6e12-4305-a91b-acbf9fe5dd29 service nova] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-441b46ab-bc16-4ac0-a39d-8b65ff1d1afd req-694224e1-6e12-4305-a91b-acbf9fe5dd29 service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] No waiting events found dispatching network-vif-plugged-3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:54 user nova-compute[71325]: WARNING nova.compute.manager [req-441b46ab-bc16-4ac0-a39d-8b65ff1d1afd req-694224e1-6e12-4305-a91b-acbf9fe5dd29 service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Received unexpected event network-vif-plugged-3a5a1230-3352-4342-80b2-5c87991a9b3d for instance with vm_state building and task_state spawning.
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Cannot resize image /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lazy-loading 'migration_context' on Instance uuid ff61d99e-4db9-421f-8c01-264a7278c095 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Ensure instance console log exists: /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Successfully created port: 8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422354.9159434, be81f393-654b-4b50-856e-00818f3ae59e => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:54 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: be81f393-654b-4b50-856e-00818f3ae59e] VM Resumed (Lifecycle Event)
Apr 13 21:45:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:45:54 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Instance spawned successfully.
Apr 13 21:45:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:55 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: be81f393-654b-4b50-856e-00818f3ae59e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422354.9259567, be81f393-654b-4b50-856e-00818f3ae59e => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:55 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: be81f393-654b-4b50-856e-00818f3ae59e] VM Started (Lifecycle Event)
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:55 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: be81f393-654b-4b50-856e-00818f3ae59e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:55 user nova-compute[71325]: INFO nova.compute.manager [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Took 9.10 seconds to spawn the instance on the hypervisor.
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:55 user nova-compute[71325]: INFO nova.compute.manager [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Took 10.67 seconds to build instance.
Apr 13 21:45:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "be81f393-654b-4b50-856e-00818f3ae59e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.817s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Successfully updated port: 8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Cleaning up deleted instances {{(pid=71325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquired lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] There are 0 instances to clean {{(pid=71325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71325) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-c8a0e949-9e10-4472-871b-a6b7e24e943d req-ba5543ef-e06c-421b-b879-ac4587946a00 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received event network-changed-8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-c8a0e949-9e10-4472-871b-a6b7e24e943d req-ba5543ef-e06c-421b-b879-ac4587946a00 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Refreshing instance network info cache due to event network-changed-8c222f8e-f61d-4b04-87c4-edd1ca83b22b. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c8a0e949-9e10-4472-871b-a6b7e24e943d req-ba5543ef-e06c-421b-b879-ac4587946a00 service nova] Acquiring lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:45:55 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Updating instance_info_cache with network_info: [{"id": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "address": "fa:16:3e:a2:5a:69", "network": {"id": "887fc8b4-07a7-4f28-8a55-c09dc080941e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-632369901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c222f8e-f6", "ovs_interfaceid": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Releasing lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Instance network_info: |[{"id": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "address": "fa:16:3e:a2:5a:69", "network": {"id": "887fc8b4-07a7-4f28-8a55-c09dc080941e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-632369901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c222f8e-f6", "ovs_interfaceid": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c8a0e949-9e10-4472-871b-a6b7e24e943d req-ba5543ef-e06c-421b-b879-ac4587946a00 service nova] Acquired lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.network.neutron [req-c8a0e949-9e10-4472-871b-a6b7e24e943d req-ba5543ef-e06c-421b-b879-ac4587946a00 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Refreshing network info cache for port 8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Start _get_guest_xml network_info=[{"id": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "address": "fa:16:3e:a2:5a:69", "network": {"id": "887fc8b4-07a7-4f28-8a55-c09dc080941e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-632369901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c222f8e-f6", "ovs_interfaceid": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:45:56 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:56 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-155987669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-155987669',id=11,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv5A5QM89WDKnsULhMuooVL+m28bgPV7OihZIzGssK7PgLTiXl/GrJAAaMRdz+PYZbhzGzt+oX5wWpDIz3NkiaY2vLH+14jBnJVm8Ym0U0jNo9V6zKnqyN1OlYdbXBS3Q==',key_name='tempest-keypair-1492294196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fd0897baf2c455c87ac9a330a673d8e',ramdisk_id='',reservation_id='r-jqdpikg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1835832502',owner_user_name='tempest-TaggedAttachmentsTest-1835832502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18587f4671a34f568e00dbee3f33eb8b',uuid=ff61d99e-4db9-421f-8c01-264a7278c095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "address": "fa:16:3e:a2:5a:69", "network": {"id": "887fc8b4-07a7-4f28-8a55-c09dc080941e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-632369901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c222f8e-f6", "ovs_interfaceid": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Converting VIF {"id": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "address": "fa:16:3e:a2:5a:69", "network": {"id": "887fc8b4-07a7-4f28-8a55-c09dc080941e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-632369901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c222f8e-f6", "ovs_interfaceid": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:5a:69,bridge_name='br-int',has_traffic_filtering=True,id=8c222f8e-f61d-4b04-87c4-edd1ca83b22b,network=Network(887fc8b4-07a7-4f28-8a55-c09dc080941e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c222f8e-f6') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lazy-loading 'pci_devices' on Instance uuid ff61d99e-4db9-421f-8c01-264a7278c095 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:45:56 user nova-compute[71325]:   <uuid>ff61d99e-4db9-421f-8c01-264a7278c095</uuid>
Apr 13 21:45:56 user nova-compute[71325]:   <name>instance-0000000b</name>
Apr 13 21:45:56 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:45:56 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:45:56 user nova-compute[71325]:   <metadata>
Apr 13 21:45:56 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:45:56 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:45:56 user nova-compute[71325]:       <nova:name>tempest-device-tagging-server-155987669</nova:name>
Apr 13 21:45:56 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:45:56</nova:creationTime>
Apr 13 21:45:56 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:45:56 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:45:56 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:45:56 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:45:56 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:45:56 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:45:56 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:45:56 user nova-compute[71325]:       <nova:owner>
Apr 13 21:45:56 user nova-compute[71325]:         <nova:user uuid="18587f4671a34f568e00dbee3f33eb8b">tempest-TaggedAttachmentsTest-1835832502-project-member</nova:user>
Apr 13 21:45:56 user nova-compute[71325]:         <nova:project uuid="2fd0897baf2c455c87ac9a330a673d8e">tempest-TaggedAttachmentsTest-1835832502</nova:project>
Apr 13 21:45:56 user nova-compute[71325]:       </nova:owner>
Apr 13 21:45:56 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:45:56 user nova-compute[71325]:       <nova:ports>
Apr 13 21:45:56 user nova-compute[71325]:         <nova:port uuid="8c222f8e-f61d-4b04-87c4-edd1ca83b22b">
Apr 13 21:45:56 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 21:45:56 user nova-compute[71325]:         </nova:port>
Apr 13 21:45:56 user nova-compute[71325]:       </nova:ports>
Apr 13 21:45:56 user nova-compute[71325]:     </nova:instance>
Apr 13 21:45:56 user nova-compute[71325]:   </metadata>
Apr 13 21:45:56 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:45:56 user nova-compute[71325]:     <system>
Apr 13 21:45:56 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:45:56 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:45:56 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:45:56 user nova-compute[71325]:       <entry name="serial">ff61d99e-4db9-421f-8c01-264a7278c095</entry>
Apr 13 21:45:56 user nova-compute[71325]:       <entry name="uuid">ff61d99e-4db9-421f-8c01-264a7278c095</entry>
Apr 13 21:45:56 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:45:56 user nova-compute[71325]:     </system>
Apr 13 21:45:56 user nova-compute[71325]:   </sysinfo>
Apr 13 21:45:56 user nova-compute[71325]:   <os>
Apr 13 21:45:56 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:45:56 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:45:56 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:45:56 user nova-compute[71325]:   </os>
Apr 13 21:45:56 user nova-compute[71325]:   <features>
Apr 13 21:45:56 user nova-compute[71325]:     <acpi/>
Apr 13 21:45:56 user nova-compute[71325]:     <apic/>
Apr 13 21:45:56 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:45:56 user nova-compute[71325]:   </features>
Apr 13 21:45:56 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:45:56 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:45:56 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:45:56 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:45:56 user nova-compute[71325]:   </clock>
Apr 13 21:45:56 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:45:56 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:45:56 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:45:56 user nova-compute[71325]:   </cpu>
Apr 13 21:45:56 user nova-compute[71325]:   <devices>
Apr 13 21:45:56 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:45:56 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:45:56 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk"/>
Apr 13 21:45:56 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:45:56 user nova-compute[71325]:     </disk>
Apr 13 21:45:56 user nova-compute[71325]:     <disk type="file" device="cdrom">
Apr 13 21:45:56 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 21:45:56 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk.config"/>
Apr 13 21:45:56 user nova-compute[71325]:       <target dev="hda" bus="ide"/>
Apr 13 21:45:56 user nova-compute[71325]:     </disk>
Apr 13 21:45:56 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:45:56 user nova-compute[71325]:       <mac address="fa:16:3e:a2:5a:69"/>
Apr 13 21:45:56 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:56 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:45:56 user nova-compute[71325]:       <target dev="tap8c222f8e-f6"/>
Apr 13 21:45:56 user nova-compute[71325]:     </interface>
Apr 13 21:45:56 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:45:56 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/console.log" append="off"/>
Apr 13 21:45:56 user nova-compute[71325]:     </serial>
Apr 13 21:45:56 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:45:56 user nova-compute[71325]:     <video>
Apr 13 21:45:56 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:45:56 user nova-compute[71325]:     </video>
Apr 13 21:45:56 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:45:56 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:45:56 user nova-compute[71325]:     </rng>
Apr 13 21:45:56 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:45:56 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:45:56 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:45:56 user nova-compute[71325]:     </memballoon>
Apr 13 21:45:56 user nova-compute[71325]:   </devices>
Apr 13 21:45:56 user nova-compute[71325]: </domain>
Apr 13 21:45:56 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-155987669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-155987669',id=11,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv5A5QM89WDKnsULhMuooVL+m28bgPV7OihZIzGssK7PgLTiXl/GrJAAaMRdz+PYZbhzGzt+oX5wWpDIz3NkiaY2vLH+14jBnJVm8Ym0U0jNo9V6zKnqyN1OlYdbXBS3Q==',key_name='tempest-keypair-1492294196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fd0897baf2c455c87ac9a330a673d8e',ramdisk_id='',reservation_id='r-jqdpikg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1835832502',owner_user_name='tempest-TaggedAttachmentsTest-1835832502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18587f4671a34f568e00dbee3f33eb8b',uuid=ff61d99e-4db9-421f-8c01-264a7278c095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "address": "fa:16:3e:a2:5a:69", "network": {"id": "887fc8b4-07a7-4f28-8a55-c09dc080941e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-632369901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c222f8e-f6", "ovs_interfaceid": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Converting VIF {"id": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "address": "fa:16:3e:a2:5a:69", "network": {"id": "887fc8b4-07a7-4f28-8a55-c09dc080941e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-632369901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c222f8e-f6", "ovs_interfaceid": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:5a:69,bridge_name='br-int',has_traffic_filtering=True,id=8c222f8e-f61d-4b04-87c4-edd1ca83b22b,network=Network(887fc8b4-07a7-4f28-8a55-c09dc080941e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c222f8e-f6') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG os_vif [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:5a:69,bridge_name='br-int',has_traffic_filtering=True,id=8c222f8e-f61d-4b04-87c4-edd1ca83b22b,network=Network(887fc8b4-07a7-4f28-8a55-c09dc080941e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c222f8e-f6') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c222f8e-f6, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c222f8e-f6, col_values=(('external_ids', {'iface-id': '8c222f8e-f61d-4b04-87c4-edd1ca83b22b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:5a:69', 'vm-uuid': 'ff61d99e-4db9-421f-8c01-264a7278c095'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:56 user nova-compute[71325]: INFO os_vif [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:5a:69,bridge_name='br-int',has_traffic_filtering=True,id=8c222f8e-f61d-4b04-87c4-edd1ca83b22b,network=Network(887fc8b4-07a7-4f28-8a55-c09dc080941e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c222f8e-f6')
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] No BDM found with device name hda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] No VIF found with MAC fa:16:3e:a2:5a:69, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:45:56 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Using config drive
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.compute.manager [req-c0803df0-5af6-4569-bc5a-5e9d3c84b1ad req-c551c909-c10a-425c-ad62-716a841d4507 service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Received event network-vif-plugged-3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c0803df0-5af6-4569-bc5a-5e9d3c84b1ad req-c551c909-c10a-425c-ad62-716a841d4507 service nova] Acquiring lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c0803df0-5af6-4569-bc5a-5e9d3c84b1ad req-c551c909-c10a-425c-ad62-716a841d4507 service nova] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c0803df0-5af6-4569-bc5a-5e9d3c84b1ad req-c551c909-c10a-425c-ad62-716a841d4507 service nova] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.compute.manager [req-c0803df0-5af6-4569-bc5a-5e9d3c84b1ad req-c551c909-c10a-425c-ad62-716a841d4507 service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] No waiting events found dispatching network-vif-plugged-3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:56 user nova-compute[71325]: WARNING nova.compute.manager [req-c0803df0-5af6-4569-bc5a-5e9d3c84b1ad req-c551c909-c10a-425c-ad62-716a841d4507 service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Received unexpected event network-vif-plugged-3a5a1230-3352-4342-80b2-5c87991a9b3d for instance with vm_state building and task_state spawning.
Apr 13 21:45:56 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Creating config drive at /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk.config
Apr 13 21:45:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpytv1szao {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpytv1szao" returned: 0 in 0.077s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.network.neutron [req-c8a0e949-9e10-4472-871b-a6b7e24e943d req-ba5543ef-e06c-421b-b879-ac4587946a00 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Updated VIF entry in instance network info cache for port 8c222f8e-f61d-4b04-87c4-edd1ca83b22b. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.network.neutron [req-c8a0e949-9e10-4472-871b-a6b7e24e943d req-ba5543ef-e06c-421b-b879-ac4587946a00 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Updating instance_info_cache with network_info: [{"id": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "address": "fa:16:3e:a2:5a:69", "network": {"id": "887fc8b4-07a7-4f28-8a55-c09dc080941e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-632369901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c222f8e-f6", "ovs_interfaceid": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c8a0e949-9e10-4472-871b-a6b7e24e943d req-ba5543ef-e06c-421b-b879-ac4587946a00 service nova] Releasing lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422356.7545109, c71cb46d-2737-4b94-8159-267ea4a0a296 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:56 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] VM Resumed (Lifecycle Event)
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:56 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Instance spawned successfully.
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:45:56 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422356.7618597, c71cb46d-2737-4b94-8159-267ea4a0a296 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:45:56 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] VM Started (Lifecycle Event)
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:45:56 user nova-compute[71325]: INFO nova.compute.manager [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Took 8.87 seconds to spawn the instance on the hypervisor.
Apr 13 21:45:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:45:56 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:45:56 user nova-compute[71325]: INFO nova.compute.manager [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Took 10.29 seconds to build instance.
Apr 13 21:45:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.506s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-365be2c9-d497-4fe5-85c0-21d9471182fb req-6ffce194-7929-4607-9721-cdf74ff71ebf service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received event network-vif-plugged-8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:45:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-365be2c9-d497-4fe5-85c0-21d9471182fb req-6ffce194-7929-4607-9721-cdf74ff71ebf service nova] Acquiring lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:45:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-365be2c9-d497-4fe5-85c0-21d9471182fb req-6ffce194-7929-4607-9721-cdf74ff71ebf service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:45:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-365be2c9-d497-4fe5-85c0-21d9471182fb req-6ffce194-7929-4607-9721-cdf74ff71ebf service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:45:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-365be2c9-d497-4fe5-85c0-21d9471182fb req-6ffce194-7929-4607-9721-cdf74ff71ebf service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] No waiting events found dispatching network-vif-plugged-8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:45:58 user nova-compute[71325]: WARNING nova.compute.manager [req-365be2c9-d497-4fe5-85c0-21d9471182fb req-6ffce194-7929-4607-9721-cdf74ff71ebf service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received unexpected event network-vif-plugged-8c222f8e-f61d-4b04-87c4-edd1ca83b22b for instance with vm_state building and task_state spawning.
Apr 13 21:45:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:45:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:45:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:45:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-a6a5c84c-13f1-4256-b8d9-50b50a7e7af4 req-4252ebff-2964-4420-b704-ffba42145126 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received event network-vif-plugged-8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a6a5c84c-13f1-4256-b8d9-50b50a7e7af4 req-4252ebff-2964-4420-b704-ffba42145126 service nova] Acquiring lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a6a5c84c-13f1-4256-b8d9-50b50a7e7af4 req-4252ebff-2964-4420-b704-ffba42145126 service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a6a5c84c-13f1-4256-b8d9-50b50a7e7af4 req-4252ebff-2964-4420-b704-ffba42145126 service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-a6a5c84c-13f1-4256-b8d9-50b50a7e7af4 req-4252ebff-2964-4420-b704-ffba42145126 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] No waiting events found dispatching network-vif-plugged-8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:46:00 user nova-compute[71325]: WARNING nova.compute.manager [req-a6a5c84c-13f1-4256-b8d9-50b50a7e7af4 req-4252ebff-2964-4420-b704-ffba42145126 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received unexpected event network-vif-plugged-8c222f8e-f61d-4b04-87c4-edd1ca83b22b for instance with vm_state building and task_state spawning.
Apr 13 21:46:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422360.9464693, ff61d99e-4db9-421f-8c01-264a7278c095 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:46:00 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] VM Resumed (Lifecycle Event)
Apr 13 21:46:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:46:00 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Instance spawned successfully.
Apr 13 21:46:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:01 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:46:01 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422360.9572122, ff61d99e-4db9-421f-8c01-264a7278c095 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:46:01 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] VM Started (Lifecycle Event)
Apr 13 21:46:01 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:46:01 user nova-compute[71325]: INFO nova.compute.manager [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Took 7.29 seconds to spawn the instance on the hypervisor.
Apr 13 21:46:01 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:46:01 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:46:01 user nova-compute[71325]: INFO nova.compute.manager [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Took 8.46 seconds to build instance.
Apr 13 21:46:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "ff61d99e-4db9-421f-8c01-264a7278c095" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.636s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:03 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:46:03 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7517MB free_disk=26.587547302246094GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance be81f393-654b-4b50-856e-00818f3ae59e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ff61d99e-4db9-421f-8c01-264a7278c095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 3a8e8627-03d4-4a17-a324-93def1017101 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c71cb46d-2737-4b94-8159-267ea4a0a296 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 35820c1d-307d-43ed-b3d1-31fe12602870 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:46:03 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:46:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:46:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.777s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:46:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:05 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:46:05 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:46:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:46:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 21:46:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:46:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:46:06 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:46:06 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lazy-loading 'info_cache' on Instance uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:46:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:06 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Updating instance_info_cache with network_info: [{"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:46:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:46:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:46:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:46:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:46:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:46:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:46:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:46:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:46:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:46:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "fe05a421-ee64-492b-a338-0e864458908c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:46:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:46:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:46:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:46:37 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:46:37 user nova-compute[71325]: INFO nova.compute.claims [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Claim successful on node user
Apr 13 21:46:37 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Refreshing inventories for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 21:46:37 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Updating ProviderTree inventory for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 21:46:37 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Updating inventory in ProviderTree for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 21:46:37 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Refreshing aggregate associations for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55, aggregates: None {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 21:46:37 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Refreshing trait associations for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 21:46:38 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:46:38 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:46:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:46:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:46:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:46:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:46:38 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:46:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:46:38 user nova-compute[71325]: DEBUG nova.policy [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:46:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:46:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:46:38 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Creating image(s)
Apr 13 21:46:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:46:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "/opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:46:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "/opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:46:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "600225933bad926e19e4dc33f9f1a6e9083a86a0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:46:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "600225933bad926e19e4dc33f9f1a6e9083a86a0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:46:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0.part --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0.part --force-share --output=json" returned: 0 in 0.176s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG nova.virt.images [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 151f8298-2e7c-4c5b-b82a-496f9533b342 was qcow2, converting to raw {{(pid=71325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0.part /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0.converted {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG nova.network.neutron [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Successfully created port: a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0.part /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0.converted" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0.converted --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "600225933bad926e19e4dc33f9f1a6e9083a86a0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.855s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0 --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "600225933bad926e19e4dc33f9f1a6e9083a86a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "600225933bad926e19e4dc33f9f1a6e9083a86a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0 --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0,backing_fmt=raw /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0,backing_fmt=raw /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk 1073741824" returned: 0 in 0.061s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "600225933bad926e19e4dc33f9f1a6e9083a86a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG nova.network.neutron [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Successfully updated port: a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquired lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:46:39 user nova-compute[71325]: DEBUG nova.network.neutron [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-b76cf98c-08d3-44fd-b2dd-fb5f88e7e8fd req-48dc66d1-db28-4871-8045-b140653c6ee8 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-changed-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-b76cf98c-08d3-44fd-b2dd-fb5f88e7e8fd req-48dc66d1-db28-4871-8045-b140653c6ee8 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Refreshing instance network info cache due to event network-changed-a6dc784b-1fab-4f4b-8e84-8df1f191b373. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b76cf98c-08d3-44fd-b2dd-fb5f88e7e8fd req-48dc66d1-db28-4871-8045-b140653c6ee8 service nova] Acquiring lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0 --force-share --output=json" returned: 0 in 0.162s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.network.neutron [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Cannot resize image /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.objects.instance [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'migration_context' on Instance uuid fe05a421-ee64-492b-a338-0e864458908c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Ensure instance console log exists: /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.network.neutron [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updating instance_info_cache with network_info: [{"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Releasing lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.compute.manager [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Instance network_info: |[{"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b76cf98c-08d3-44fd-b2dd-fb5f88e7e8fd req-48dc66d1-db28-4871-8045-b140653c6ee8 service nova] Acquired lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.network.neutron [req-b76cf98c-08d3-44fd-b2dd-fb5f88e7e8fd req-48dc66d1-db28-4871-8045-b140653c6ee8 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Refreshing network info cache for port a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Start _get_guest_xml network_info=[{"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:46:35Z,direct_url=<?>,disk_format='qcow2',id=151f8298-2e7c-4c5b-b82a-496f9533b342,min_disk=0,min_ram=0,name='tempest-scenario-img--439641056',owner='7d4e8c27ff7d4fa9a61e000c9d02c5f4',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:46:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '151f8298-2e7c-4c5b-b82a-496f9533b342'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:46:40 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:46:40 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:46:35Z,direct_url=<?>,disk_format='qcow2',id=151f8298-2e7c-4c5b-b82a-496f9533b342,min_disk=0,min_ram=0,name='tempest-scenario-img--439641056',owner='7d4e8c27ff7d4fa9a61e000c9d02c5f4',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:46:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1041715874',display_name='tempest-TestMinimumBasicScenario-server-1041715874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1041715874',id=12,image_ref='151f8298-2e7c-4c5b-b82a-496f9533b342',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrF4HyOOJH3pMivnghQrjFo+W8h3ND4pdRgXep1SFS8/WTYjcNCQm2ws2bOjH7uTrYfCv8CUrUqbd3voRDTocx9SqboUPZF+TWklO/M1CRGmsArlRpxU4SyKxVWG+qBZw==',key_name='tempest-TestMinimumBasicScenario-1695743106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d4e8c27ff7d4fa9a61e000c9d02c5f4',ramdisk_id='',reservation_id='r-vzgmgg3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='151f8298-2e7c-4c5b-b82a-496f9533b342',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1800545339',owner_user_name='tempest-TestMinimumBasicScenario-1800545339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:46:39Z,user_data=None,user_id='710e0446cf794e94b3ab29bb0d7e10d8',uuid=fe05a421-ee64-492b-a338-0e864458908c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converting VIF {"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:dc:b4,bridge_name='br-int',has_traffic_filtering=True,id=a6dc784b-1fab-4f4b-8e84-8df1f191b373,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc784b-1f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.objects.instance [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'pci_devices' on Instance uuid fe05a421-ee64-492b-a338-0e864458908c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:46:40 user nova-compute[71325]:   <uuid>fe05a421-ee64-492b-a338-0e864458908c</uuid>
Apr 13 21:46:40 user nova-compute[71325]:   <name>instance-0000000c</name>
Apr 13 21:46:40 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:46:40 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:46:40 user nova-compute[71325]:   <metadata>
Apr 13 21:46:40 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:46:40 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:46:40 user nova-compute[71325]:       <nova:name>tempest-TestMinimumBasicScenario-server-1041715874</nova:name>
Apr 13 21:46:40 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:46:40</nova:creationTime>
Apr 13 21:46:40 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:46:40 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:46:40 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:46:40 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:46:40 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:46:40 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:46:40 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:46:40 user nova-compute[71325]:       <nova:owner>
Apr 13 21:46:40 user nova-compute[71325]:         <nova:user uuid="710e0446cf794e94b3ab29bb0d7e10d8">tempest-TestMinimumBasicScenario-1800545339-project-member</nova:user>
Apr 13 21:46:40 user nova-compute[71325]:         <nova:project uuid="7d4e8c27ff7d4fa9a61e000c9d02c5f4">tempest-TestMinimumBasicScenario-1800545339</nova:project>
Apr 13 21:46:40 user nova-compute[71325]:       </nova:owner>
Apr 13 21:46:40 user nova-compute[71325]:       <nova:root type="image" uuid="151f8298-2e7c-4c5b-b82a-496f9533b342"/>
Apr 13 21:46:40 user nova-compute[71325]:       <nova:ports>
Apr 13 21:46:40 user nova-compute[71325]:         <nova:port uuid="a6dc784b-1fab-4f4b-8e84-8df1f191b373">
Apr 13 21:46:40 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 21:46:40 user nova-compute[71325]:         </nova:port>
Apr 13 21:46:40 user nova-compute[71325]:       </nova:ports>
Apr 13 21:46:40 user nova-compute[71325]:     </nova:instance>
Apr 13 21:46:40 user nova-compute[71325]:   </metadata>
Apr 13 21:46:40 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:46:40 user nova-compute[71325]:     <system>
Apr 13 21:46:40 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:46:40 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:46:40 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:46:40 user nova-compute[71325]:       <entry name="serial">fe05a421-ee64-492b-a338-0e864458908c</entry>
Apr 13 21:46:40 user nova-compute[71325]:       <entry name="uuid">fe05a421-ee64-492b-a338-0e864458908c</entry>
Apr 13 21:46:40 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:46:40 user nova-compute[71325]:     </system>
Apr 13 21:46:40 user nova-compute[71325]:   </sysinfo>
Apr 13 21:46:40 user nova-compute[71325]:   <os>
Apr 13 21:46:40 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:46:40 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:46:40 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:46:40 user nova-compute[71325]:   </os>
Apr 13 21:46:40 user nova-compute[71325]:   <features>
Apr 13 21:46:40 user nova-compute[71325]:     <acpi/>
Apr 13 21:46:40 user nova-compute[71325]:     <apic/>
Apr 13 21:46:40 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:46:40 user nova-compute[71325]:   </features>
Apr 13 21:46:40 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:46:40 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:46:40 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:46:40 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:46:40 user nova-compute[71325]:   </clock>
Apr 13 21:46:40 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:46:40 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:46:40 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:46:40 user nova-compute[71325]:   </cpu>
Apr 13 21:46:40 user nova-compute[71325]:   <devices>
Apr 13 21:46:40 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:46:40 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:46:40 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk"/>
Apr 13 21:46:40 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:46:40 user nova-compute[71325]:     </disk>
Apr 13 21:46:40 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:46:40 user nova-compute[71325]:       <mac address="fa:16:3e:cf:dc:b4"/>
Apr 13 21:46:40 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:46:40 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:46:40 user nova-compute[71325]:       <target dev="tapa6dc784b-1f"/>
Apr 13 21:46:40 user nova-compute[71325]:     </interface>
Apr 13 21:46:40 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:46:40 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/console.log" append="off"/>
Apr 13 21:46:40 user nova-compute[71325]:     </serial>
Apr 13 21:46:40 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:46:40 user nova-compute[71325]:     <video>
Apr 13 21:46:40 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:46:40 user nova-compute[71325]:     </video>
Apr 13 21:46:40 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:46:40 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:46:40 user nova-compute[71325]:     </rng>
Apr 13 21:46:40 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:46:40 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:46:40 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:46:40 user nova-compute[71325]:     </memballoon>
Apr 13 21:46:40 user nova-compute[71325]:   </devices>
Apr 13 21:46:40 user nova-compute[71325]: </domain>
Apr 13 21:46:40 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1041715874',display_name='tempest-TestMinimumBasicScenario-server-1041715874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1041715874',id=12,image_ref='151f8298-2e7c-4c5b-b82a-496f9533b342',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrF4HyOOJH3pMivnghQrjFo+W8h3ND4pdRgXep1SFS8/WTYjcNCQm2ws2bOjH7uTrYfCv8CUrUqbd3voRDTocx9SqboUPZF+TWklO/M1CRGmsArlRpxU4SyKxVWG+qBZw==',key_name='tempest-TestMinimumBasicScenario-1695743106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d4e8c27ff7d4fa9a61e000c9d02c5f4',ramdisk_id='',reservation_id='r-vzgmgg3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='151f8298-2e7c-4c5b-b82a-496f9533b342',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1800545339',owner_user_name='tempest-TestMinimumBasicScenario-1800545339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:46:39Z,user_data=None,user_id='710e0446cf794e94b3ab29bb0d7e10d8',uuid=fe05a421-ee64-492b-a338-0e864458908c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converting VIF {"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:dc:b4,bridge_name='br-int',has_traffic_filtering=True,id=a6dc784b-1fab-4f4b-8e84-8df1f191b373,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc784b-1f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG os_vif [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:dc:b4,bridge_name='br-int',has_traffic_filtering=True,id=a6dc784b-1fab-4f4b-8e84-8df1f191b373,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc784b-1f') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6dc784b-1f, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6dc784b-1f, col_values=(('external_ids', {'iface-id': 'a6dc784b-1fab-4f4b-8e84-8df1f191b373', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:dc:b4', 'vm-uuid': 'fe05a421-ee64-492b-a338-0e864458908c'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:40 user nova-compute[71325]: INFO os_vif [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:dc:b4,bridge_name='br-int',has_traffic_filtering=True,id=a6dc784b-1fab-4f4b-8e84-8df1f191b373,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc784b-1f')
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] No VIF found with MAC fa:16:3e:cf:dc:b4, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.network.neutron [req-b76cf98c-08d3-44fd-b2dd-fb5f88e7e8fd req-48dc66d1-db28-4871-8045-b140653c6ee8 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updated VIF entry in instance network info cache for port a6dc784b-1fab-4f4b-8e84-8df1f191b373. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG nova.network.neutron [req-b76cf98c-08d3-44fd-b2dd-fb5f88e7e8fd req-48dc66d1-db28-4871-8045-b140653c6ee8 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updating instance_info_cache with network_info: [{"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:46:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b76cf98c-08d3-44fd-b2dd-fb5f88e7e8fd req-48dc66d1-db28-4871-8045-b140653c6ee8 service nova] Releasing lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:46:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-07004719-b7da-4296-9d12-908ee535485e req-982c5edb-c77f-4765-8165-f98930349494 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:46:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-07004719-b7da-4296-9d12-908ee535485e req-982c5edb-c77f-4765-8165-f98930349494 service nova] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:46:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-07004719-b7da-4296-9d12-908ee535485e req-982c5edb-c77f-4765-8165-f98930349494 service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:46:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-07004719-b7da-4296-9d12-908ee535485e req-982c5edb-c77f-4765-8165-f98930349494 service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:46:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-07004719-b7da-4296-9d12-908ee535485e req-982c5edb-c77f-4765-8165-f98930349494 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] No waiting events found dispatching network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:46:42 user nova-compute[71325]: WARNING nova.compute.manager [req-07004719-b7da-4296-9d12-908ee535485e req-982c5edb-c77f-4765-8165-f98930349494 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received unexpected event network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance with vm_state building and task_state spawning.
Apr 13 21:46:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422404.162508, fe05a421-ee64-492b-a338-0e864458908c => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:46:44 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] VM Resumed (Lifecycle Event)
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:46:44 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: fe05a421-ee64-492b-a338-0e864458908c] Instance spawned successfully.
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:46:44 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422404.1647463, fe05a421-ee64-492b-a338-0e864458908c => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:46:44 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] VM Started (Lifecycle Event)
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:46:44 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-d66d8e66-4a84-4790-a9b7-2ba9df7cb01a req-26c86cc8-8298-4aa6-946e-d4a2330709a7 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d66d8e66-4a84-4790-a9b7-2ba9df7cb01a req-26c86cc8-8298-4aa6-946e-d4a2330709a7 service nova] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d66d8e66-4a84-4790-a9b7-2ba9df7cb01a req-26c86cc8-8298-4aa6-946e-d4a2330709a7 service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d66d8e66-4a84-4790-a9b7-2ba9df7cb01a req-26c86cc8-8298-4aa6-946e-d4a2330709a7 service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-d66d8e66-4a84-4790-a9b7-2ba9df7cb01a req-26c86cc8-8298-4aa6-946e-d4a2330709a7 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] No waiting events found dispatching network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:46:44 user nova-compute[71325]: WARNING nova.compute.manager [req-d66d8e66-4a84-4790-a9b7-2ba9df7cb01a req-26c86cc8-8298-4aa6-946e-d4a2330709a7 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received unexpected event network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance with vm_state building and task_state spawning.
Apr 13 21:46:44 user nova-compute[71325]: INFO nova.compute.manager [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Took 5.67 seconds to spawn the instance on the hypervisor.
Apr 13 21:46:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:46:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:44 user nova-compute[71325]: INFO nova.compute.manager [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Took 6.85 seconds to build instance.
Apr 13 21:46:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "fe05a421-ee64-492b-a338-0e864458908c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.946s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:46:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:58 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:46:58 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:46:58 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:46:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:46:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:46:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:46:58 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:46:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:46:59 user nova-compute[71325]: INFO nova.compute.claims [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Claim successful on node user
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:46:59 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:47:00 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:47:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG nova.policy [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02a7fc7a42b441cfa3c6bc04f4dd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1071d640fb44ff9966fab7888668ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:47:00 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Creating image(s)
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "/opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "/opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.185s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:00 user nova-compute[71325]: INFO nova.compute.manager [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Rescuing
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquired lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG nova.network.neutron [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/disk 1073741824" returned: 0 in 0.061s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-f8558bb1-a638-48ce-95b8-ca6f38729a43 req-c0737e8a-c8c2-427f-bff7-99dbd4955e52 service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-changed-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-f8558bb1-a638-48ce-95b8-ca6f38729a43 req-c0737e8a-c8c2-427f-bff7-99dbd4955e52 service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Refreshing instance network info cache due to event network-changed-a70898ac-83fd-4f25-be37-aef7c87f6059. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f8558bb1-a638-48ce-95b8-ca6f38729a43 req-c0737e8a-c8c2-427f-bff7-99dbd4955e52 service nova] Acquiring lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f8558bb1-a638-48ce-95b8-ca6f38729a43 req-c0737e8a-c8c2-427f-bff7-99dbd4955e52 service nova] Acquired lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG nova.network.neutron [req-f8558bb1-a638-48ce-95b8-ca6f38729a43 req-c0737e8a-c8c2-427f-bff7-99dbd4955e52 service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Refreshing network info cache for port a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.160s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Successfully created port: 2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Cannot resize image /opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lazy-loading 'migration_context' on Instance uuid eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Ensure instance console log exists: /opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG nova.network.neutron [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Updating instance_info_cache with network_info: [{"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Releasing lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:02 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Instance destroyed successfully.
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.network.neutron [req-f8558bb1-a638-48ce-95b8-ca6f38729a43 req-c0737e8a-c8c2-427f-bff7-99dbd4955e52 service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Updated VIF entry in instance network info cache for port a70898ac-83fd-4f25-be37-aef7c87f6059. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.network.neutron [req-f8558bb1-a638-48ce-95b8-ca6f38729a43 req-c0737e8a-c8c2-427f-bff7-99dbd4955e52 service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Updating instance_info_cache with network_info: [{"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:02 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Attempting rescue
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71325) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Instance directory exists: not creating {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 21:47:02 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Creating image(s)
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "/opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "/opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "/opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.objects.instance [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68cb788e-be1f-44fc-b65e-b908a5831ae2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f8558bb1-a638-48ce-95b8-ca6f38729a43 req-c0737e8a-c8c2-427f-bff7-99dbd4955e52 service nova] Releasing lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.compute.manager [req-c3c8fd05-ba78-4f0a-9506-4b7faa893a68 req-f4dbbd2d-a524-449a-a036-43b8efc0e006 service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received event network-vif-unplugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c3c8fd05-ba78-4f0a-9506-4b7faa893a68 req-f4dbbd2d-a524-449a-a036-43b8efc0e006 service nova] Acquiring lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c3c8fd05-ba78-4f0a-9506-4b7faa893a68 req-f4dbbd2d-a524-449a-a036-43b8efc0e006 service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c3c8fd05-ba78-4f0a-9506-4b7faa893a68 req-f4dbbd2d-a524-449a-a036-43b8efc0e006 service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.compute.manager [req-c3c8fd05-ba78-4f0a-9506-4b7faa893a68 req-f4dbbd2d-a524-449a-a036-43b8efc0e006 service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] No waiting events found dispatching network-vif-unplugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:02 user nova-compute[71325]: WARNING nova.compute.manager [req-c3c8fd05-ba78-4f0a-9506-4b7faa893a68 req-f4dbbd2d-a524-449a-a036-43b8efc0e006 service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received unexpected event network-vif-unplugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance with vm_state active and task_state rescuing.
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue" returned: 0 in 0.049s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.objects.instance [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'migration_context' on Instance uuid 68cb788e-be1f-44fc-b65e-b908a5831ae2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Start _get_guest_xml network_info=[{"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "vif_mac": "fa:16:3e:73:ba:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.objects.instance [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'resources' on Instance uuid 68cb788e-be1f-44fc-b65e-b908a5831ae2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.objects.instance [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'numa_topology' on Instance uuid 68cb788e-be1f-44fc-b65e-b908a5831ae2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:02 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:47:02 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.objects.instance [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68cb788e-be1f-44fc-b65e-b908a5831ae2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-402733805',display_name='tempest-ServerRescueNegativeTestJSON-server-402733805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-402733805',id=4,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70e84a09a76a44eb830e575db4321224',ramdisk_id='',reservation_id='r-e2h2pfno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-546430736',owner_user_name='tempest-ServerRescueNegativeTestJSON-546430736-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:30Z,user_data=None,user_id='e77459bc3fa8496da1a089c460e32ed2',uuid=68cb788e-be1f-44fc-b65e-b908a5831ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "vif_mac": "fa:16:3e:73:ba:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converting VIF {"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "vif_mac": "fa:16:3e:73:ba:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:ba:92,bridge_name='br-int',has_traffic_filtering=True,id=b4a7d649-3cf1-4452-9f1d-430f0ce841ca,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a7d649-3c') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.objects.instance [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'pci_devices' on Instance uuid 68cb788e-be1f-44fc-b65e-b908a5831ae2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:47:02 user nova-compute[71325]:   <uuid>68cb788e-be1f-44fc-b65e-b908a5831ae2</uuid>
Apr 13 21:47:02 user nova-compute[71325]:   <name>instance-00000004</name>
Apr 13 21:47:02 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:47:02 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:47:02 user nova-compute[71325]:   <metadata>
Apr 13 21:47:02 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:47:02 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:47:02 user nova-compute[71325]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-402733805</nova:name>
Apr 13 21:47:02 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:47:02</nova:creationTime>
Apr 13 21:47:02 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:47:02 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:47:02 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:47:02 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:47:02 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:47:02 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:47:02 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:47:02 user nova-compute[71325]:       <nova:owner>
Apr 13 21:47:02 user nova-compute[71325]:         <nova:user uuid="e77459bc3fa8496da1a089c460e32ed2">tempest-ServerRescueNegativeTestJSON-546430736-project-member</nova:user>
Apr 13 21:47:02 user nova-compute[71325]:         <nova:project uuid="70e84a09a76a44eb830e575db4321224">tempest-ServerRescueNegativeTestJSON-546430736</nova:project>
Apr 13 21:47:02 user nova-compute[71325]:       </nova:owner>
Apr 13 21:47:02 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:47:02 user nova-compute[71325]:       <nova:ports>
Apr 13 21:47:02 user nova-compute[71325]:         <nova:port uuid="b4a7d649-3cf1-4452-9f1d-430f0ce841ca">
Apr 13 21:47:02 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 21:47:02 user nova-compute[71325]:         </nova:port>
Apr 13 21:47:02 user nova-compute[71325]:       </nova:ports>
Apr 13 21:47:02 user nova-compute[71325]:     </nova:instance>
Apr 13 21:47:02 user nova-compute[71325]:   </metadata>
Apr 13 21:47:02 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:47:02 user nova-compute[71325]:     <system>
Apr 13 21:47:02 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:47:02 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:47:02 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:47:02 user nova-compute[71325]:       <entry name="serial">68cb788e-be1f-44fc-b65e-b908a5831ae2</entry>
Apr 13 21:47:02 user nova-compute[71325]:       <entry name="uuid">68cb788e-be1f-44fc-b65e-b908a5831ae2</entry>
Apr 13 21:47:02 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:47:02 user nova-compute[71325]:     </system>
Apr 13 21:47:02 user nova-compute[71325]:   </sysinfo>
Apr 13 21:47:02 user nova-compute[71325]:   <os>
Apr 13 21:47:02 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:47:02 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:47:02 user nova-compute[71325]:   </os>
Apr 13 21:47:02 user nova-compute[71325]:   <features>
Apr 13 21:47:02 user nova-compute[71325]:     <acpi/>
Apr 13 21:47:02 user nova-compute[71325]:     <apic/>
Apr 13 21:47:02 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:47:02 user nova-compute[71325]:   </features>
Apr 13 21:47:02 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:47:02 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:47:02 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:47:02 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:47:02 user nova-compute[71325]:   </clock>
Apr 13 21:47:02 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:47:02 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:47:02 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:47:02 user nova-compute[71325]:   </cpu>
Apr 13 21:47:02 user nova-compute[71325]:   <devices>
Apr 13 21:47:02 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:47:02 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:47:02 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue"/>
Apr 13 21:47:02 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:47:02 user nova-compute[71325]:     </disk>
Apr 13 21:47:02 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:47:02 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:47:02 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk"/>
Apr 13 21:47:02 user nova-compute[71325]:       <target dev="vdb" bus="virtio"/>
Apr 13 21:47:02 user nova-compute[71325]:     </disk>
Apr 13 21:47:02 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:47:02 user nova-compute[71325]:       <mac address="fa:16:3e:73:ba:92"/>
Apr 13 21:47:02 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:47:02 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:47:02 user nova-compute[71325]:       <target dev="tapb4a7d649-3c"/>
Apr 13 21:47:02 user nova-compute[71325]:     </interface>
Apr 13 21:47:02 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:47:02 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/console.log" append="off"/>
Apr 13 21:47:02 user nova-compute[71325]:     </serial>
Apr 13 21:47:02 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:47:02 user nova-compute[71325]:     <video>
Apr 13 21:47:02 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:47:02 user nova-compute[71325]:     </video>
Apr 13 21:47:02 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:47:02 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:47:02 user nova-compute[71325]:     </rng>
Apr 13 21:47:02 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:47:02 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:47:02 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:47:02 user nova-compute[71325]:     </memballoon>
Apr 13 21:47:02 user nova-compute[71325]:   </devices>
Apr 13 21:47:02 user nova-compute[71325]: </domain>
Apr 13 21:47:02 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Successfully updated port: 2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:02 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Instance destroyed successfully.
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "refresh_cache-eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquired lock "refresh_cache-eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:02 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:47:03 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:47:03 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7028MB free_disk=26.43643569946289GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No VIF found with MAC fa:16:3e:73:ba:92, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance be81f393-654b-4b50-856e-00818f3ae59e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ff61d99e-4db9-421f-8c01-264a7278c095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 3a8e8627-03d4-4a17-a324-93def1017101 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c71cb46d-2737-4b94-8159-267ea4a0a296 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance fe05a421-ee64-492b-a338-0e864458908c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 35820c1d-307d-43ed-b3d1-31fe12602870 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Updating instance_info_cache with network_info: [{"id": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "address": "fa:16:3e:9a:e4:f0", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dfaa3c7-5c", "ovs_interfaceid": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Releasing lock "refresh_cache-eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Instance network_info: |[{"id": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "address": "fa:16:3e:9a:e4:f0", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dfaa3c7-5c", "ovs_interfaceid": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Start _get_guest_xml network_info=[{"id": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "address": "fa:16:3e:9a:e4:f0", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dfaa3c7-5c", "ovs_interfaceid": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:47:03 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:47:03 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-386129097',display_name='tempest-ServersNegativeTestJSON-server-386129097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-386129097',id=13,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1071d640fb44ff9966fab7888668ed5',ramdisk_id='',reservation_id='r-xfcgg0aj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1571285098',owner_user_name='tempest-ServersNegativeTestJSON-1571285098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:47:00Z,user_data=None,user_id='02a7fc7a42b441cfa3c6bc04f4dd6cb9',uuid=eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "address": "fa:16:3e:9a:e4:f0", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dfaa3c7-5c", "ovs_interfaceid": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Converting VIF {"id": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "address": "fa:16:3e:9a:e4:f0", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dfaa3c7-5c", "ovs_interfaceid": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e4:f0,bridge_name='br-int',has_traffic_filtering=True,id=2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea,network=Network(ed9169cc-af6d-4d31-9b2e-9016c5f963c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dfaa3c7-5c') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lazy-loading 'pci_devices' on Instance uuid eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:47:03 user nova-compute[71325]:   <uuid>eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f</uuid>
Apr 13 21:47:03 user nova-compute[71325]:   <name>instance-0000000d</name>
Apr 13 21:47:03 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:47:03 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:47:03 user nova-compute[71325]:   <metadata>
Apr 13 21:47:03 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:47:03 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:47:03 user nova-compute[71325]:       <nova:name>tempest-ServersNegativeTestJSON-server-386129097</nova:name>
Apr 13 21:47:03 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:47:03</nova:creationTime>
Apr 13 21:47:03 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:47:03 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:47:03 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:47:03 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:47:03 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:47:03 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:47:03 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:47:03 user nova-compute[71325]:       <nova:owner>
Apr 13 21:47:03 user nova-compute[71325]:         <nova:user uuid="02a7fc7a42b441cfa3c6bc04f4dd6cb9">tempest-ServersNegativeTestJSON-1571285098-project-member</nova:user>
Apr 13 21:47:03 user nova-compute[71325]:         <nova:project uuid="f1071d640fb44ff9966fab7888668ed5">tempest-ServersNegativeTestJSON-1571285098</nova:project>
Apr 13 21:47:03 user nova-compute[71325]:       </nova:owner>
Apr 13 21:47:03 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:47:03 user nova-compute[71325]:       <nova:ports>
Apr 13 21:47:03 user nova-compute[71325]:         <nova:port uuid="2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea">
Apr 13 21:47:03 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 21:47:03 user nova-compute[71325]:         </nova:port>
Apr 13 21:47:03 user nova-compute[71325]:       </nova:ports>
Apr 13 21:47:03 user nova-compute[71325]:     </nova:instance>
Apr 13 21:47:03 user nova-compute[71325]:   </metadata>
Apr 13 21:47:03 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:47:03 user nova-compute[71325]:     <system>
Apr 13 21:47:03 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:47:03 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:47:03 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:47:03 user nova-compute[71325]:       <entry name="serial">eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f</entry>
Apr 13 21:47:03 user nova-compute[71325]:       <entry name="uuid">eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f</entry>
Apr 13 21:47:03 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:47:03 user nova-compute[71325]:     </system>
Apr 13 21:47:03 user nova-compute[71325]:   </sysinfo>
Apr 13 21:47:03 user nova-compute[71325]:   <os>
Apr 13 21:47:03 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:47:03 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:47:03 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:47:03 user nova-compute[71325]:   </os>
Apr 13 21:47:03 user nova-compute[71325]:   <features>
Apr 13 21:47:03 user nova-compute[71325]:     <acpi/>
Apr 13 21:47:03 user nova-compute[71325]:     <apic/>
Apr 13 21:47:03 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:47:03 user nova-compute[71325]:   </features>
Apr 13 21:47:03 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:47:03 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:47:03 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:47:03 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:47:03 user nova-compute[71325]:   </clock>
Apr 13 21:47:03 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:47:03 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:47:03 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:47:03 user nova-compute[71325]:   </cpu>
Apr 13 21:47:03 user nova-compute[71325]:   <devices>
Apr 13 21:47:03 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:47:03 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:47:03 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/disk"/>
Apr 13 21:47:03 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:47:03 user nova-compute[71325]:     </disk>
Apr 13 21:47:03 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:47:03 user nova-compute[71325]:       <mac address="fa:16:3e:9a:e4:f0"/>
Apr 13 21:47:03 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:47:03 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:47:03 user nova-compute[71325]:       <target dev="tap2dfaa3c7-5c"/>
Apr 13 21:47:03 user nova-compute[71325]:     </interface>
Apr 13 21:47:03 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:47:03 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/console.log" append="off"/>
Apr 13 21:47:03 user nova-compute[71325]:     </serial>
Apr 13 21:47:03 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:47:03 user nova-compute[71325]:     <video>
Apr 13 21:47:03 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:47:03 user nova-compute[71325]:     </video>
Apr 13 21:47:03 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:47:03 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:47:03 user nova-compute[71325]:     </rng>
Apr 13 21:47:03 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:47:03 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:47:03 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:47:03 user nova-compute[71325]:     </memballoon>
Apr 13 21:47:03 user nova-compute[71325]:   </devices>
Apr 13 21:47:03 user nova-compute[71325]: </domain>
Apr 13 21:47:03 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-386129097',display_name='tempest-ServersNegativeTestJSON-server-386129097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-386129097',id=13,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1071d640fb44ff9966fab7888668ed5',ramdisk_id='',reservation_id='r-xfcgg0aj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1571285098',owner_user_name='tempest-ServersNegativeTestJSON-1571285098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:47:00Z,user_data=None,user_id='02a7fc7a42b441cfa3c6bc04f4dd6cb9',uuid=eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "address": "fa:16:3e:9a:e4:f0", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dfaa3c7-5c", "ovs_interfaceid": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Converting VIF {"id": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "address": "fa:16:3e:9a:e4:f0", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dfaa3c7-5c", "ovs_interfaceid": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e4:f0,bridge_name='br-int',has_traffic_filtering=True,id=2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea,network=Network(ed9169cc-af6d-4d31-9b2e-9016c5f963c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dfaa3c7-5c') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG os_vif [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e4:f0,bridge_name='br-int',has_traffic_filtering=True,id=2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea,network=Network(ed9169cc-af6d-4d31-9b2e-9016c5f963c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dfaa3c7-5c') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dfaa3c7-5c, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dfaa3c7-5c, col_values=(('external_ids', {'iface-id': '2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:e4:f0', 'vm-uuid': 'eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:03 user nova-compute[71325]: INFO os_vif [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e4:f0,bridge_name='br-int',has_traffic_filtering=True,id=2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea,network=Network(ed9169cc-af6d-4d31-9b2e-9016c5f963c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dfaa3c7-5c')
Apr 13 21:47:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'flavor' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] No VIF found with MAC fa:16:3e:9a:e4:f0, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.698s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:03 user nova-compute[71325]: INFO nova.compute.manager [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Attaching volume 5c84a9a6-d73f-46ba-b157-ba2642a6a5ae to /dev/vdb
Apr 13 21:47:04 user nova-compute[71325]: DEBUG os_brick.utils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:04 user nova-compute[71325]: INFO oslo.privsep.daemon [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpwb0ol0g2/privsep.sock']
Apr 13 21:47:04 user sudo[82456]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpwb0ol0g2/privsep.sock
Apr 13 21:47:04 user sudo[82456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 21:47:04 user nova-compute[71325]: DEBUG nova.compute.manager [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received event network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] Acquiring lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG nova.compute.manager [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] No waiting events found dispatching network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:04 user nova-compute[71325]: WARNING nova.compute.manager [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received unexpected event network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance with vm_state active and task_state rescuing.
Apr 13 21:47:04 user nova-compute[71325]: DEBUG nova.compute.manager [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Received event network-changed-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG nova.compute.manager [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Refreshing instance network info cache due to event network-changed-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] Acquiring lock "refresh_cache-eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] Acquired lock "refresh_cache-eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG nova.network.neutron [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Refreshing network info cache for port 2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG nova.network.neutron [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Updated VIF entry in instance network info cache for port 2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG nova.network.neutron [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Updating instance_info_cache with network_info: [{"id": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "address": "fa:16:3e:9a:e4:f0", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dfaa3c7-5c", "ovs_interfaceid": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] Releasing lock "refresh_cache-eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:47:04 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-8645ede7-1e10-4520-8092-6cc6dfc3d82a" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-8645ede7-1e10-4520-8092-6cc6dfc3d82a" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Updating instance_info_cache with network_info: [{"id": "ba4d973f-18b3-4b49-b663-627155851ce8", "address": "fa:16:3e:36:cc:b4", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4d973f-18", "ovs_interfaceid": "ba4d973f-18b3-4b49-b663-627155851ce8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:05 user sudo[82456]: pam_unix(sudo:session): session closed for user root
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-8645ede7-1e10-4520-8092-6cc6dfc3d82a" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:47:05 user nova-compute[71325]: INFO oslo.privsep.daemon [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Spawned new privsep daemon via rootwrap
Apr 13 21:47:05 user nova-compute[71325]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 21:47:05 user nova-compute[71325]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 21:47:05 user nova-compute[71325]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 13 21:47:05 user nova-compute[71325]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82476
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d6f399-a9ce-4436-a6ab-e435072affcd]: (2,) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[41986c64-6b76-4266-9f44-6866a60c5e06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:05 user nova-compute[71325]: WARNING os_brick.initiator.connectors.nvmeof [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0baae14-b58c-41be-b83e-ef0f16c25e90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f41112-d72c-416d-a9c1-5120cbb2a925]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7598e311-ed31-41bf-95cf-ed8388817341]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:05 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:47:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f95f4c2-368e-4f22-b4f3-3591789251cc]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG os_brick.utils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] <== get_connector_properties: return (1969ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Updating existing volume attachment record: 69bd7a81-7d84-4e52-a21e-1d9e44697a06 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG nova.compute.manager [req-b4df9446-251d-49f8-834c-d5ff0e2fd9d9 req-db748aa0-bce3-4e50-b0e8-3e557752c123 service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Received event network-vif-plugged-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b4df9446-251d-49f8-834c-d5ff0e2fd9d9 req-db748aa0-bce3-4e50-b0e8-3e557752c123 service nova] Acquiring lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b4df9446-251d-49f8-834c-d5ff0e2fd9d9 req-db748aa0-bce3-4e50-b0e8-3e557752c123 service nova] Lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b4df9446-251d-49f8-834c-d5ff0e2fd9d9 req-db748aa0-bce3-4e50-b0e8-3e557752c123 service nova] Lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG nova.compute.manager [req-b4df9446-251d-49f8-834c-d5ff0e2fd9d9 req-db748aa0-bce3-4e50-b0e8-3e557752c123 service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] No waiting events found dispatching network-vif-plugged-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:06 user nova-compute[71325]: WARNING nova.compute.manager [req-b4df9446-251d-49f8-834c-d5ff0e2fd9d9 req-db748aa0-bce3-4e50-b0e8-3e557752c123 service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Received unexpected event network-vif-plugged-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea for instance with vm_state building and task_state spawning.
Apr 13 21:47:06 user nova-compute[71325]: DEBUG nova.compute.manager [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received event network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] Acquiring lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG nova.compute.manager [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] No waiting events found dispatching network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:06 user nova-compute[71325]: WARNING nova.compute.manager [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received unexpected event network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance with vm_state active and task_state rescuing.
Apr 13 21:47:06 user nova-compute[71325]: DEBUG nova.compute.manager [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received event network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] Acquiring lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:06 user nova-compute[71325]: DEBUG nova.compute.manager [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] No waiting events found dispatching network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:06 user nova-compute[71325]: WARNING nova.compute.manager [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received unexpected event network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance with vm_state active and task_state rescuing.
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "3a8e8627-03d4-4a17-a324-93def1017101" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "3a8e8627-03d4-4a17-a324-93def1017101" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG nova.objects.instance [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lazy-loading 'flavor' on Instance uuid 3a8e8627-03d4-4a17-a324-93def1017101 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "3a8e8627-03d4-4a17-a324-93def1017101" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "3a8e8627-03d4-4a17-a324-93def1017101" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "3a8e8627-03d4-4a17-a324-93def1017101" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:07 user nova-compute[71325]: INFO nova.compute.manager [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Attaching volume 8880fa93-2a7f-4694-8158-f5da64668e3e to /dev/vdb
Apr 13 21:47:07 user nova-compute[71325]: DEBUG os_brick.utils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[520a29a4-b876-4a83-bdd2-2ef8066989bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b4a5f3-70e6-4d88-902c-4c4f4f5baf50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b73f59-a314-4d2e-86b9-38eb50363d8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb14887-bd46-43ef-900d-79212e96477b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:07 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:47:07 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ca7c7a-f0a8-4759-99f3-5e57e63c3749]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG os_brick.utils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:07 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Updating existing volume attachment record: a5cfdeb5-a371-4997-af92-7bae75b8369f {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [req-09d12e25-47bc-4540-ae0f-394b5a6113b3 req-d6982653-c07d-4fb0-8a96-a280cc7362ca service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Received event network-vif-plugged-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-09d12e25-47bc-4540-ae0f-394b5a6113b3 req-d6982653-c07d-4fb0-8a96-a280cc7362ca service nova] Acquiring lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-09d12e25-47bc-4540-ae0f-394b5a6113b3 req-d6982653-c07d-4fb0-8a96-a280cc7362ca service nova] Lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-09d12e25-47bc-4540-ae0f-394b5a6113b3 req-d6982653-c07d-4fb0-8a96-a280cc7362ca service nova] Lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [req-09d12e25-47bc-4540-ae0f-394b5a6113b3 req-d6982653-c07d-4fb0-8a96-a280cc7362ca service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] No waiting events found dispatching network-vif-plugged-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:08 user nova-compute[71325]: WARNING nova.compute.manager [req-09d12e25-47bc-4540-ae0f-394b5a6113b3 req-d6982653-c07d-4fb0-8a96-a280cc7362ca service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Received unexpected event network-vif-plugged-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea for instance with vm_state building and task_state spawning.
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422428.476407, eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:47:08 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] VM Resumed (Lifecycle Event)
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:47:08 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Instance spawned successfully.
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:47:08 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for 68cb788e-be1f-44fc-b65e-b908a5831ae2 due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422428.4770055, 68cb788e-be1f-44fc-b65e-b908a5831ae2 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:47:08 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] VM Resumed (Lifecycle Event)
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:08 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422428.478982, eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:47:08 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] VM Started (Lifecycle Event)
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:47:08 user nova-compute[71325]: INFO nova.compute.manager [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Took 8.39 seconds to spawn the instance on the hypervisor.
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:47:08 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422428.4790604, 68cb788e-be1f-44fc-b65e-b908a5831ae2 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:47:08 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] VM Started (Lifecycle Event)
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:47:08 user nova-compute[71325]: INFO nova.compute.manager [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Took 9.40 seconds to build instance.
Apr 13 21:47:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.522s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [req-c65348a1-f77a-460f-826b-76f5cf135c6b req-488bcc6b-82df-4c16-9448-ccdc9468481c service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-changed-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.compute.manager [req-c65348a1-f77a-460f-826b-76f5cf135c6b req-488bcc6b-82df-4c16-9448-ccdc9468481c service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Refreshing instance network info cache due to event network-changed-e918ab8f-9fcd-47df-974d-eb6568414011. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c65348a1-f77a-460f-826b-76f5cf135c6b req-488bcc6b-82df-4c16-9448-ccdc9468481c service nova] Acquiring lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c65348a1-f77a-460f-826b-76f5cf135c6b req-488bcc6b-82df-4c16-9448-ccdc9468481c service nova] Acquired lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:08 user nova-compute[71325]: DEBUG nova.network.neutron [req-c65348a1-f77a-460f-826b-76f5cf135c6b req-488bcc6b-82df-4c16-9448-ccdc9468481c service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Refreshing network info cache for port e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:47:09 user nova-compute[71325]: DEBUG nova.network.neutron [req-c65348a1-f77a-460f-826b-76f5cf135c6b req-488bcc6b-82df-4c16-9448-ccdc9468481c service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updated VIF entry in instance network info cache for port e918ab8f-9fcd-47df-974d-eb6568414011. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:47:09 user nova-compute[71325]: DEBUG nova.network.neutron [req-c65348a1-f77a-460f-826b-76f5cf135c6b req-488bcc6b-82df-4c16-9448-ccdc9468481c service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updating instance_info_cache with network_info: [{"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c65348a1-f77a-460f-826b-76f5cf135c6b req-488bcc6b-82df-4c16-9448-ccdc9468481c service nova] Releasing lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:10 user nova-compute[71325]: DEBUG nova.compute.manager [req-dc7fbe5a-1989-47e5-b177-a33a156980a5 req-0231eff3-4bb9-4af8-b21b-ba088e7966d9 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-changed-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:10 user nova-compute[71325]: DEBUG nova.compute.manager [req-dc7fbe5a-1989-47e5-b177-a33a156980a5 req-0231eff3-4bb9-4af8-b21b-ba088e7966d9 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Refreshing instance network info cache due to event network-changed-f0a7bc69-be17-49d2-94fc-40541afce8ed. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:47:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dc7fbe5a-1989-47e5-b177-a33a156980a5 req-0231eff3-4bb9-4af8-b21b-ba088e7966d9 service nova] Acquiring lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dc7fbe5a-1989-47e5-b177-a33a156980a5 req-0231eff3-4bb9-4af8-b21b-ba088e7966d9 service nova] Acquired lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:10 user nova-compute[71325]: DEBUG nova.network.neutron [req-dc7fbe5a-1989-47e5-b177-a33a156980a5 req-0231eff3-4bb9-4af8-b21b-ba088e7966d9 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Refreshing network info cache for port f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connector [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Factory for ISCSI on None {{(pid=71325) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwMuKBIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:11 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:11 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:11 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d86c0e-7773-4c2c-87bf-64b56d3271cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:47:11 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[55df75ba-1bdc-43ed-b8ba-720a0fecc7ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae] added
Apr 13 21:47:11 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b58bfa-ee71-4e9f-9891-495943f6d7d2]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7c0842-860d-43dd-b307-09c539e6f5df]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwMuKBIj {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwMuKBIj" returned: 0 in 0.031s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3892933-6f9c-4874-a623-62dfcf1de997]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PwMuKBIj'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG nova.network.neutron [req-dc7fbe5a-1989-47e5-b177-a33a156980a5 req-0231eff3-4bb9-4af8-b21b-ba088e7966d9 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updated VIF entry in instance network info cache for port f0a7bc69-be17-49d2-94fc-40541afce8ed. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG nova.network.neutron [req-dc7fbe5a-1989-47e5-b177-a33a156980a5 req-0231eff3-4bb9-4af8-b21b-ba088e7966d9 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updating instance_info_cache with network_info: [{"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dc7fbe5a-1989-47e5-b177-a33a156980a5 req-0231eff3-4bb9-4af8-b21b-ba088e7966d9 service nova] Releasing lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cf918a-409b-4e4c-837f-4b9d27b3973a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2d443e-22c5-44ef-b925-5b4fd19d23e3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 21:47:11 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 21:47:11 user nova-compute[71325]:  {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:11 user nova-compute[71325]: WARNING os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 21:47:11 user nova-compute[71325]: 
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea967a7-cdad-4514-881c-c470c9c062f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260]
Apr 13 21:47:11 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260] successful.
Apr 13 21:47:11 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c6ad5f-89fc-4a00-84ae-6875fb5bb30a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2920bc-20f7-42d7-86a9-cba7334bc37e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:11 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:11 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[333443e8-c285-4e6d-b0a6-3414acfb23fb]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwMuKBIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:47:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:47:12 user nova-compute[71325]: INFO nova.compute.manager [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] instance snapshotting
Apr 13 21:47:12 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Beginning live snapshot process
Apr 13 21:47:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json -f qcow2 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json -f qcow2" returned: 0 in 0.163s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json -f qcow2 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:12 user nova-compute[71325]: INFO nova.compute.manager [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Shelving
Apr 13 21:47:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '23734383034383064', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734383034383064', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:47:12 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'flavor' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json -f qcow2" returned: 0 in 0.160s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:47:12 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:47:12 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 21:47:12 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:47:12 user nova-compute[71325]:   <serial>5c84a9a6-d73f-46ba-b157-ba2642a6a5ae</serial>
Apr 13 21:47:12 user nova-compute[71325]: </disk>
Apr 13 21:47:12 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:47:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.184s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprmplczmy/ee23ab67f0134b45a73903ccc6a0b77f.delta 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprmplczmy/ee23ab67f0134b45a73903ccc6a0b77f.delta 1073741824" returned: 0 in 0.072s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:13 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 21:47:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71325) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 13 21:47:13 user nova-compute[71325]: INFO nova.virt.libvirt.host [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] UEFI support detected
Apr 13 21:47:13 user nova-compute[71325]: DEBUG nova.compute.manager [req-d2f7023e-1144-41f6-9d46-a5941fc16a62 req-ee16a6cc-3530-480d-b12e-1718e6a28afd service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-vif-unplugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d2f7023e-1144-41f6-9d46-a5941fc16a62 req-ee16a6cc-3530-480d-b12e-1718e6a28afd service nova] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d2f7023e-1144-41f6-9d46-a5941fc16a62 req-ee16a6cc-3530-480d-b12e-1718e6a28afd service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d2f7023e-1144-41f6-9d46-a5941fc16a62 req-ee16a6cc-3530-480d-b12e-1718e6a28afd service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG nova.compute.manager [req-d2f7023e-1144-41f6-9d46-a5941fc16a62 req-ee16a6cc-3530-480d-b12e-1718e6a28afd service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] No waiting events found dispatching network-vif-unplugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:13 user nova-compute[71325]: WARNING nova.compute.manager [req-d2f7023e-1144-41f6-9d46-a5941fc16a62 req-ee16a6cc-3530-480d-b12e-1718e6a28afd service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received unexpected event network-vif-unplugged-e918ab8f-9fcd-47df-974d-eb6568414011 for instance with vm_state active and task_state shelving.
Apr 13 21:47:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] No VIF found with MAC fa:16:3e:fd:52:e7, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.659s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:13 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Instance destroyed successfully.
Apr 13 21:47:13 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Beginning cold snapshot process
Apr 13 21:47:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk /opt/stack/data/nova/instances/snapshots/tmpx6ojuuzh/aa828f39005e473a98e04fc249f1640f {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-861122e9-f6d6-418a-bde1-34788813c584 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-861122e9-f6d6-418a-bde1-34788813c584 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-861122e9-f6d6-418a-bde1-34788813c584 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-861122e9-f6d6-418a-bde1-34788813c584 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71325) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG nova.objects.instance [None req-861122e9-f6d6-418a-bde1-34788813c584 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'flavor' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk /opt/stack/data/nova/instances/snapshots/tmpx6ojuuzh/aa828f39005e473a98e04fc249f1640f" returned: 0 in 0.891s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:14 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Snapshot extracted, beginning image upload
Apr 13 21:47:15 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Instance destroyed successfully.
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-861122e9-f6d6-418a-bde1-34788813c584 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:15 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-861122e9-f6d6-418a-bde1-34788813c584 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.020s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprmplczmy/ee23ab67f0134b45a73903ccc6a0b77f.delta /opt/stack/data/nova/instances/snapshots/tmprmplczmy/ee23ab67f0134b45a73903ccc6a0b77f {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] No waiting events found dispatching network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:15 user nova-compute[71325]: WARNING nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received unexpected event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] No waiting events found dispatching network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:15 user nova-compute[71325]: WARNING nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received unexpected event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] No waiting events found dispatching network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:15 user nova-compute[71325]: WARNING nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received unexpected event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-vif-unplugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] No waiting events found dispatching network-vif-unplugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:15 user nova-compute[71325]: WARNING nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received unexpected event network-vif-unplugged-e918ab8f-9fcd-47df-974d-eb6568414011 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] No waiting events found dispatching network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:15 user nova-compute[71325]: WARNING nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received unexpected event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-vif-unplugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] No waiting events found dispatching network-vif-unplugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:15 user nova-compute[71325]: WARNING nova.compute.manager [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received unexpected event network-vif-unplugged-a70898ac-83fd-4f25-be37-aef7c87f6059 for instance with vm_state stopped and task_state None.
Apr 13 21:47:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprmplczmy/ee23ab67f0134b45a73903ccc6a0b77f.delta /opt/stack/data/nova/instances/snapshots/tmprmplczmy/ee23ab67f0134b45a73903ccc6a0b77f" returned: 0 in 0.320s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:15 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Snapshot extracted, beginning image upload
Apr 13 21:47:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEVAygzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:16 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:16 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:16 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0913a9b-e405-4aee-a428-de4eeea2e570]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:47:16 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[215cd18c-4cb4-417d-aebf-010ca333cec4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e] added
Apr 13 21:47:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e7534c-98ef-49bc-aa57-645cbf0698e8]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fee05e-6b10-4fa2-b452-ee067ec9869a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eEVAygzG {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eEVAygzG" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b923cb-7d0d-45ad-94e6-e866c02c3553]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eEVAygzG'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5bc531-a97c-4966-b000-4c27809ac207]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[48df3e31-1b53-4ff9-b251-305c8433b587]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[251d15f8-2e18-4e18-a897-ed8441311ab8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e, portal: 172.16.0.220,3260]
Apr 13 21:47:16 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e, portal: 172.16.0.220,3260] successful.
Apr 13 21:47:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[868926fa-9685-4e5e-8d7a-42deffc2b830]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a69460-8567-46cf-931e-f45ad08e450a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:16 user nova-compute[71325]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e (non-flash)
Apr 13 21:47:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:16 user nova-compute[71325]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e (non-flash)
Apr 13 21:47:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[811d53e7-7b4c-419c-9b51-45fd849c8c1a]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:47:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEVAygzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:47:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-0853e39b-795f-4263-b824-faabe290c4f9 req-644b45a5-7dee-4e0f-b7eb-682b28bf9bbb service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0853e39b-795f-4263-b824-faabe290c4f9 req-644b45a5-7dee-4e0f-b7eb-682b28bf9bbb service nova] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0853e39b-795f-4263-b824-faabe290c4f9 req-644b45a5-7dee-4e0f-b7eb-682b28bf9bbb service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0853e39b-795f-4263-b824-faabe290c4f9 req-644b45a5-7dee-4e0f-b7eb-682b28bf9bbb service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-0853e39b-795f-4263-b824-faabe290c4f9 req-644b45a5-7dee-4e0f-b7eb-682b28bf9bbb service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] No waiting events found dispatching network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:17 user nova-compute[71325]: WARNING nova.compute.manager [req-0853e39b-795f-4263-b824-faabe290c4f9 req-644b45a5-7dee-4e0f-b7eb-682b28bf9bbb service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received unexpected event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 for instance with vm_state stopped and task_state None.
Apr 13 21:47:17 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Snapshot image upload complete
Apr 13 21:47:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:47:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26638383166636139', 'path': '/dev/sdc'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638383166636139', 'path': '/dev/sdc'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:47:17 user nova-compute[71325]: DEBUG nova.objects.instance [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lazy-loading 'flavor' on Instance uuid 3a8e8627-03d4-4a17-a324-93def1017101 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:17 user nova-compute[71325]: INFO nova.compute.manager [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Shelve offloading
Apr 13 21:47:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:47:17 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:47:17 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:47:17 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:47:17 user nova-compute[71325]:   <serial>8880fa93-2a7f-4694-8158-f5da64668e3e</serial>
Apr 13 21:47:17 user nova-compute[71325]: </disk>
Apr 13 21:47:17 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:47:17 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Instance destroyed successfully.
Apr 13 21:47:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:47:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquired lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:17 user nova-compute[71325]: DEBUG nova.network.neutron [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:47:18 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Snapshot image upload complete
Apr 13 21:47:18 user nova-compute[71325]: INFO nova.compute.manager [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Took 5.89 seconds to snapshot the instance on the hypervisor.
Apr 13 21:47:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] No VIF found with MAC fa:16:3e:97:cb:19, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:47:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "3a8e8627-03d4-4a17-a324-93def1017101" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.932s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updating instance_info_cache with network_info: [{"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Releasing lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:18 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Instance destroyed successfully.
Apr 13 21:47:18 user nova-compute[71325]: DEBUG nova.objects.instance [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'resources' on Instance uuid eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1025681919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1025681919',id=6,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7Ml5lpGb1VqwPVwkwwsf5pboDo62epDSWqFRNEqAUVYF/2w516xO62Qmmp9j0l22MQEwYg4/k1ON4am0hAmYwpEbqC0e1pEBIaEp/IKSH66LA6p3lpAdZWEotG6J5hwQ==',key_name='tempest-keypair-1819128718',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='73c23bc3e8b14441b4622095502b5dae',ramdisk_id='',reservation_id='r-m0kiebsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-710815470',owner_user_name='tempest-AttachVolumeShelveTestJSON-710815470-project-member',shelved_at='2023-04-13T21:47:17.645749',shelved_host='user',shelved_image_id='53583ecc-7b0f-4a49-9837-b60d794a3cfc'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f151b673e3d47acb9c3ed9b9ecaf687',uuid=eaff33f4-c1f5-45c5-b54f-555d1c66e8c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converting VIF {"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:19:65,bridge_name='br-int',has_traffic_filtering=True,id=e918ab8f-9fcd-47df-974d-eb6568414011,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape918ab8f-9f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG os_vif [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:19:65,bridge_name='br-int',has_traffic_filtering=True,id=e918ab8f-9fcd-47df-974d-eb6568414011,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape918ab8f-9f') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape918ab8f-9f, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:19 user nova-compute[71325]: INFO os_vif [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:19:65,bridge_name='br-int',has_traffic_filtering=True,id=e918ab8f-9fcd-47df-974d-eb6568414011,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape918ab8f-9f')
Apr 13 21:47:19 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Deleting instance files /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7_del
Apr 13 21:47:19 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Deletion of /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7_del complete
Apr 13 21:47:19 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Deleted allocations for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7
Apr 13 21:47:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'numa_topology' on Instance uuid eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-90888f89-ae91-445b-81a5-541d349bf402 req-84af14e7-314b-4e85-954d-36c2325abbfe service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-changed-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-90888f89-ae91-445b-81a5-541d349bf402 req-84af14e7-314b-4e85-954d-36c2325abbfe service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Refreshing instance network info cache due to event network-changed-e918ab8f-9fcd-47df-974d-eb6568414011. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-90888f89-ae91-445b-81a5-541d349bf402 req-84af14e7-314b-4e85-954d-36c2325abbfe service nova] Acquiring lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-90888f89-ae91-445b-81a5-541d349bf402 req-84af14e7-314b-4e85-954d-36c2325abbfe service nova] Acquired lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG nova.network.neutron [req-90888f89-ae91-445b-81a5-541d349bf402 req-84af14e7-314b-4e85-954d-36c2325abbfe service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Refreshing network info cache for port e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "3a8e8627-03d4-4a17-a324-93def1017101" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "3a8e8627-03d4-4a17-a324-93def1017101" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "3a8e8627-03d4-4a17-a324-93def1017101-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "3a8e8627-03d4-4a17-a324-93def1017101-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "3a8e8627-03d4-4a17-a324-93def1017101-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:19 user nova-compute[71325]: INFO nova.compute.manager [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Terminating instance
Apr 13 21:47:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.109s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG nova.network.neutron [req-90888f89-ae91-445b-81a5-541d349bf402 req-84af14e7-314b-4e85-954d-36c2325abbfe service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updated VIF entry in instance network info cache for port e918ab8f-9fcd-47df-974d-eb6568414011. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG nova.network.neutron [req-90888f89-ae91-445b-81a5-541d349bf402 req-84af14e7-314b-4e85-954d-36c2325abbfe service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updating instance_info_cache with network_info: [{"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape918ab8f-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-90888f89-ae91-445b-81a5-541d349bf402 req-84af14e7-314b-4e85-954d-36c2325abbfe service nova] Releasing lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:20 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Instance destroyed successfully.
Apr 13 21:47:20 user nova-compute[71325]: DEBUG nova.objects.instance [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lazy-loading 'resources' on Instance uuid 3a8e8627-03d4-4a17-a324-93def1017101 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1801509642',display_name='tempest-DeleteServersTestJSON-server-1801509642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1801509642',id=5,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45aed26c3fb143cab8c3c1599f70d858',ramdisk_id='',reservation_id='r-4r0fmyj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-698852050',owner_user_name='tempest-DeleteServersTestJSON-698852050-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:45:31Z,user_data=None,user_id='7299dc5fc1ad4f3eb769eda4dac5abe1',uuid=3a8e8627-03d4-4a17-a324-93def1017101,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "address": "fa:16:3e:97:cb:19", "network": {"id": "77c75177-3563-451c-a6d0-02f4c7cd7a7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1925575035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45aed26c3fb143cab8c3c1599f70d858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9262ff5-d9", "ovs_interfaceid": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Converting VIF {"id": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "address": "fa:16:3e:97:cb:19", "network": {"id": "77c75177-3563-451c-a6d0-02f4c7cd7a7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1925575035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45aed26c3fb143cab8c3c1599f70d858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9262ff5-d9", "ovs_interfaceid": "a9262ff5-d93b-430d-839d-39cdfccb47c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=a9262ff5-d93b-430d-839d-39cdfccb47c4,network=Network(77c75177-3563-451c-a6d0-02f4c7cd7a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9262ff5-d9') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_vif [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=a9262ff5-d93b-430d-839d-39cdfccb47c4,network=Network(77c75177-3563-451c-a6d0-02f4c7cd7a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9262ff5-d9') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9262ff5-d9, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:20 user nova-compute[71325]: INFO os_vif [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=a9262ff5-d93b-430d-839d-39cdfccb47c4,network=Network(77c75177-3563-451c-a6d0-02f4c7cd7a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9262ff5-d9')
Apr 13 21:47:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEVAygzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:20 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec7a7fa-4a3d-45bb-a647-34de933c4771]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:47:20 user nova-compute[71325]: No targets found.
Apr 13 21:47:20 user nova-compute[71325]: iSNS:
Apr 13 21:47:20 user nova-compute[71325]: No targets found.
Apr 13 21:47:20 user nova-compute[71325]: STATIC:
Apr 13 21:47:20 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae
Apr 13 21:47:20 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:20 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:20 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e
Apr 13 21:47:20 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:20 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:20 user nova-compute[71325]: FIRMWARE:
Apr 13 21:47:20 user nova-compute[71325]: No targets found.
Apr 13 21:47:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:47:20 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:47:20 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d562c8-af7d-4c51-af7a-2ca2d73ca3b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaa88ed-90e3-4e18-9fd2-3b700ed577ab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:20 user nova-compute[71325]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e (non-flash)
Apr 13 21:47:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:20 user nova-compute[71325]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e (non-flash)
Apr 13 21:47:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7e8fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e'): ({'sdc'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Removing single pathed devices sdc {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af55672-7f8b-4d55-b5b8-814693f426e6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[17438b63-5bf9-4813-96b5-6606fab5bb54]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Flushing IO for device /dev/sdc {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[112470fa-b815-4f79-a577-cd96542621f3]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1fcf13-39e8-469c-91b5-c355ee0e97c1]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d765bea4-54b1-4503-b74b-c909f30e0d92]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f472b94-de33-4a14-b278-bcd7b4f9dcb4]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e, portal: 172.16.0.220,3260]
Apr 13 21:47:20 user nova-compute[71325]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e, portal: 172.16.0.220,3260] successful.
Apr 13 21:47:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8880fa93-2a7f-4694-8158-f5da64668e3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[10703695-0b3f-4f39-8187-70248f4fd9e7]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] <== disconnect_volume: return (293ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:47:20 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Deleting instance files /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101_del
Apr 13 21:47:20 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Deletion of /opt/stack/data/nova/instances/3a8e8627-03d4-4a17-a324-93def1017101_del complete
Apr 13 21:47:20 user nova-compute[71325]: INFO nova.compute.manager [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 13 21:47:20 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:47:20 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:47:21 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:21 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Took 0.63 seconds to deallocate network for instance.
Apr 13 21:47:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Received event network-vif-unplugged-a9262ff5-d93b-430d-839d-39cdfccb47c4 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] Acquiring lock "3a8e8627-03d4-4a17-a324-93def1017101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] Lock "3a8e8627-03d4-4a17-a324-93def1017101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] Lock "3a8e8627-03d4-4a17-a324-93def1017101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] No waiting events found dispatching network-vif-unplugged-a9262ff5-d93b-430d-839d-39cdfccb47c4 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Received event network-vif-unplugged-a9262ff5-d93b-430d-839d-39cdfccb47c4 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:47:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Received event network-vif-plugged-a9262ff5-d93b-430d-839d-39cdfccb47c4 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] Acquiring lock "3a8e8627-03d4-4a17-a324-93def1017101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] Lock "3a8e8627-03d4-4a17-a324-93def1017101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] Lock "3a8e8627-03d4-4a17-a324-93def1017101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] No waiting events found dispatching network-vif-plugged-a9262ff5-d93b-430d-839d-39cdfccb47c4 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:21 user nova-compute[71325]: WARNING nova.compute.manager [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Received unexpected event network-vif-plugged-a9262ff5-d93b-430d-839d-39cdfccb47c4 for instance with vm_state active and task_state deleting.
Apr 13 21:47:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Received event network-vif-deleted-a9262ff5-d93b-430d-839d-39cdfccb47c4 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:22 user nova-compute[71325]: INFO nova.compute.manager [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Took 0.86 seconds to detach 1 volumes for instance.
Apr 13 21:47:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:22 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:47:22 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:47:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:22 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Deleted allocations for instance 3a8e8627-03d4-4a17-a324-93def1017101
Apr 13 21:47:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "3a8e8627-03d4-4a17-a324-93def1017101" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.230s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:28 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422433.7167149, eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:47:28 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] VM Stopped (Lifecycle Event)
Apr 13 21:47:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4c02993f-d48a-4bdf-9200-8e6fdf9676a5 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:47:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:30 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422435.064173, ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:47:30 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] VM Stopped (Lifecycle Event)
Apr 13 21:47:30 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ac3c7b3-af8c-48e8-8084-769156ef521a None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:47:30 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ac3c7b3-af8c-48e8-8084-769156ef521a None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:47:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-fcec7048-5a2a-4ca0-a308-2d2e36681e7a req-64b8e162-0e1c-41ce-af13-338c6e974ae9 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Received event network-changed-015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-fcec7048-5a2a-4ca0-a308-2d2e36681e7a req-64b8e162-0e1c-41ce-af13-338c6e974ae9 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Refreshing instance network info cache due to event network-changed-015b54d3-245f-448a-b918-e53aaeed180f. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-fcec7048-5a2a-4ca0-a308-2d2e36681e7a req-64b8e162-0e1c-41ce-af13-338c6e974ae9 service nova] Acquiring lock "refresh_cache-35820c1d-307d-43ed-b3d1-31fe12602870" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-fcec7048-5a2a-4ca0-a308-2d2e36681e7a req-64b8e162-0e1c-41ce-af13-338c6e974ae9 service nova] Acquired lock "refresh_cache-35820c1d-307d-43ed-b3d1-31fe12602870" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG nova.network.neutron [req-fcec7048-5a2a-4ca0-a308-2d2e36681e7a req-64b8e162-0e1c-41ce-af13-338c6e974ae9 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Refreshing network info cache for port 015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "35820c1d-307d-43ed-b3d1-31fe12602870" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "35820c1d-307d-43ed-b3d1-31fe12602870" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG nova.objects.instance [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lazy-loading 'flavor' on Instance uuid 35820c1d-307d-43ed-b3d1-31fe12602870 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "35820c1d-307d-43ed-b3d1-31fe12602870" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "35820c1d-307d-43ed-b3d1-31fe12602870" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "35820c1d-307d-43ed-b3d1-31fe12602870" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:32 user nova-compute[71325]: INFO nova.compute.manager [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Attaching volume 36939113-535a-44e7-a3b9-f81c95e278c4 to /dev/vdb
Apr 13 21:47:32 user nova-compute[71325]: DEBUG os_brick.utils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ac3c31-6e2f-4cb6-949e-00f17058a1cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a50366-00d4-42b1-a85a-e1c5f3e7293e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80611bf-e8e4-45f5-bd4e-8d2f0dfaa306]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1539b999-5f16-4c03-80a1-2f9102589034]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:32 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d82487-1223-4b82-ba4a-31ed8eb97d9a]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG os_brick.utils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Updating existing volume attachment record: 69895fc9-2f89-4c73-9e6c-14946068973c {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG nova.network.neutron [req-fcec7048-5a2a-4ca0-a308-2d2e36681e7a req-64b8e162-0e1c-41ce-af13-338c6e974ae9 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Updated VIF entry in instance network info cache for port 015b54d3-245f-448a-b918-e53aaeed180f. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG nova.network.neutron [req-fcec7048-5a2a-4ca0-a308-2d2e36681e7a req-64b8e162-0e1c-41ce-af13-338c6e974ae9 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Updating instance_info_cache with network_info: [{"id": "015b54d3-245f-448a-b918-e53aaeed180f", "address": "fa:16:3e:fa:b5:73", "network": {"id": "2c235eb0-e303-4d17-a1d6-b2a05c1adeb5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1743492804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8cec16877149a6824b9292c1065c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b54d3-24", "ovs_interfaceid": "015b54d3-245f-448a-b918-e53aaeed180f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-fcec7048-5a2a-4ca0-a308-2d2e36681e7a req-64b8e162-0e1c-41ce-af13-338c6e974ae9 service nova] Releasing lock "refresh_cache-35820c1d-307d-43ed-b3d1-31fe12602870" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-6ffb5419-3e09-44f2-937a-cac7fd27f781 req-0cd63109-b2d0-4d17-93bc-7598e4dec388 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Received event network-changed-c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-6ffb5419-3e09-44f2-937a-cac7fd27f781 req-0cd63109-b2d0-4d17-93bc-7598e4dec388 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Refreshing instance network info cache due to event network-changed-c0b475f1-01a2-4492-ac88-67f44080f771. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:47:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ffb5419-3e09-44f2-937a-cac7fd27f781 req-0cd63109-b2d0-4d17-93bc-7598e4dec388 service nova] Acquiring lock "refresh_cache-be81f393-654b-4b50-856e-00818f3ae59e" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ffb5419-3e09-44f2-937a-cac7fd27f781 req-0cd63109-b2d0-4d17-93bc-7598e4dec388 service nova] Acquired lock "refresh_cache-be81f393-654b-4b50-856e-00818f3ae59e" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:34 user nova-compute[71325]: DEBUG nova.network.neutron [req-6ffb5419-3e09-44f2-937a-cac7fd27f781 req-0cd63109-b2d0-4d17-93bc-7598e4dec388 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Refreshing network info cache for port c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:47:35 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422440.284571, 3a8e8627-03d4-4a17-a324-93def1017101 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:47:35 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] VM Stopped (Lifecycle Event)
Apr 13 21:47:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-98b46d02-62fc-4165-b307-fe4bb59d8dcd None None] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:47:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:35 user nova-compute[71325]: DEBUG nova.network.neutron [req-6ffb5419-3e09-44f2-937a-cac7fd27f781 req-0cd63109-b2d0-4d17-93bc-7598e4dec388 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Updated VIF entry in instance network info cache for port c0b475f1-01a2-4492-ac88-67f44080f771. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:47:35 user nova-compute[71325]: DEBUG nova.network.neutron [req-6ffb5419-3e09-44f2-937a-cac7fd27f781 req-0cd63109-b2d0-4d17-93bc-7598e4dec388 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Updating instance_info_cache with network_info: [{"id": "c0b475f1-01a2-4492-ac88-67f44080f771", "address": "fa:16:3e:02:59:10", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0b475f1-01", "ovs_interfaceid": "c0b475f1-01a2-4492-ac88-67f44080f771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ffb5419-3e09-44f2-937a-cac7fd27f781 req-0cd63109-b2d0-4d17-93bc-7598e4dec388 service nova] Releasing lock "refresh_cache-be81f393-654b-4b50-856e-00818f3ae59e" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "be81f393-654b-4b50-856e-00818f3ae59e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "be81f393-654b-4b50-856e-00818f3ae59e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG nova.objects.instance [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lazy-loading 'flavor' on Instance uuid be81f393-654b-4b50-856e-00818f3ae59e {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "be81f393-654b-4b50-856e-00818f3ae59e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "be81f393-654b-4b50-856e-00818f3ae59e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "be81f393-654b-4b50-856e-00818f3ae59e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:36 user nova-compute[71325]: INFO nova.compute.manager [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Attaching volume 14774bd1-7eae-45fb-adfc-31c4d866a06d to /dev/vdb
Apr 13 21:47:36 user nova-compute[71325]: DEBUG os_brick.utils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1572062d-b089-4b0b-ba15-7b7e65f64d88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[21202bb2-6f17-4ead-98eb-4a04e9e5aa10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecd43da-4b96-4ab2-94ab-bbdd6747e488]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4388134-4b8b-4e8d-888d-f8704b299324]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:36 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:47:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e18e8cd-8abe-46ea-90a3-a2944c9de7c7]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG os_brick.utils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:36 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Updating existing volume attachment record: 1fdb7aa2-ac36-467b-b79f-67002f1fa33e {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-ae8cd970-0ba4-4cdf-b220-7d3a6bfecb52 req-1905eebe-4547-4afb-8b14-8d836169e1ec service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Received event network-changed-3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-ae8cd970-0ba4-4cdf-b220-7d3a6bfecb52 req-1905eebe-4547-4afb-8b14-8d836169e1ec service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Refreshing instance network info cache due to event network-changed-3a5a1230-3352-4342-80b2-5c87991a9b3d. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ae8cd970-0ba4-4cdf-b220-7d3a6bfecb52 req-1905eebe-4547-4afb-8b14-8d836169e1ec service nova] Acquiring lock "refresh_cache-c71cb46d-2737-4b94-8159-267ea4a0a296" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ae8cd970-0ba4-4cdf-b220-7d3a6bfecb52 req-1905eebe-4547-4afb-8b14-8d836169e1ec service nova] Acquired lock "refresh_cache-c71cb46d-2737-4b94-8159-267ea4a0a296" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-ae8cd970-0ba4-4cdf-b220-7d3a6bfecb52 req-1905eebe-4547-4afb-8b14-8d836169e1ec service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Refreshing network info cache for port 3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoQMDOWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:37 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:37 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:37 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3a80c3-54b7-430c-9976-d8bfc068ebe7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:47:37 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d4e26e-64c7-4c2e-96ef-0b2cf3638d85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4] added
Apr 13 21:47:37 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a5b04f-bc60-4020-8f89-38f964824965]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac713870-9dd6-4d80-a81a-c99772ea1e1a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KoQMDOWl {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KoQMDOWl" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a025ce87-190b-4d12-8f90-626ed33b9279]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KoQMDOWl'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[382ee5a5-8ce2-4296-b4b8-b9015cb94383]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9232d1-1cb7-467b-a269-1cd495fa9673]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:37 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:37 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[989dec09-ca09-41da-bec7-9fe7426403ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260]
Apr 13 21:47:37 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260] successful.
Apr 13 21:47:37 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcc7d3b-a64b-47f2-a025-247bc0bca6a4]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc61b2e-25ce-4e1d-8398-98ca1bca00ad]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:37 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:37 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:37 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:37 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6be80e-9168-417d-bc7d-f77a0a529b16]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoQMDOWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-ae8cd970-0ba4-4cdf-b220-7d3a6bfecb52 req-1905eebe-4547-4afb-8b14-8d836169e1ec service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Updated VIF entry in instance network info cache for port 3a5a1230-3352-4342-80b2-5c87991a9b3d. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-ae8cd970-0ba4-4cdf-b220-7d3a6bfecb52 req-1905eebe-4547-4afb-8b14-8d836169e1ec service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Updating instance_info_cache with network_info: [{"id": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "address": "fa:16:3e:70:87:1e", "network": {"id": "b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1362663481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddcd2da3f5e4a148bef3c7c4adce6db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5a1230-33", "ovs_interfaceid": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ae8cd970-0ba4-4cdf-b220-7d3a6bfecb52 req-1905eebe-4547-4afb-8b14-8d836169e1ec service nova] Releasing lock "refresh_cache-c71cb46d-2737-4b94-8159-267ea4a0a296" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "c71cb46d-2737-4b94-8159-267ea4a0a296" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26234386532343530', 'path': '/dev/sdc'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234386532343530', 'path': '/dev/sdc'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG nova.objects.instance [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lazy-loading 'flavor' on Instance uuid 35820c1d-307d-43ed-b3d1-31fe12602870 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG nova.objects.instance [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lazy-loading 'flavor' on Instance uuid c71cb46d-2737-4b94-8159-267ea4a0a296 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:47:38 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:47:38 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:47:38 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:47:38 user nova-compute[71325]:   <serial>36939113-535a-44e7-a3b9-f81c95e278c4</serial>
Apr 13 21:47:38 user nova-compute[71325]: </disk>
Apr 13 21:47:38 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "c71cb46d-2737-4b94-8159-267ea4a0a296" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:38 user nova-compute[71325]: INFO nova.compute.manager [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Attaching volume ec590b36-5a34-4473-be50-d525f384e5da to /dev/sdc
Apr 13 21:47:38 user nova-compute[71325]: DEBUG os_brick.utils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca956ebf-7ff5-44f6-9bb2-88b984541158]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b95ecf-9359-4e92-bc77-81baa763e6c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[720f9251-bc01-44f8-b3d9-50dcdbd502d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[964a081f-0112-46c4-a08a-3ab246fbc400]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:38 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:47:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ba009e-cd52-41b3-956b-a29c630bb445]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG os_brick.utils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:38 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Updating existing volume attachment record: 62f901b8-203a-49d6-a5c4-dcca2c195379 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:47:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] No VIF found with MAC fa:16:3e:fa:b5:73, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:47:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "35820c1d-307d-43ed-b3d1-31fe12602870" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.745s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Acquiring lock "35820c1d-307d-43ed-b3d1-31fe12602870" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "35820c1d-307d-43ed-b3d1-31fe12602870" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG os_brick.utils [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[049ed62e-384c-4d47-b46d-a908d5578170]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdbd6ce-a847-425c-ad4c-13ca1a46331a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a9fb72-00f9-44f3-be31-35831822ddeb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a688371-7cc7-41ca-8ea3-261d619fac4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:40 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:47:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0577d2-a493-46de-a912-e405c9a96c63]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:47:40 user nova-compute[71325]: DEBUG os_brick.utils [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:41 user nova-compute[71325]: INFO nova.compute.manager [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Swapping volume 36939113-535a-44e7-a3b9-f81c95e278c4 for 232f1088-3899-4c7b-afcb-b2847abf5b27
Apr 13 21:47:41 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmxrBWHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:41 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:41 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:41 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[247d4137-8e8b-4cc1-bc8d-7ddc76484709]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:47:41 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[96440acd-c7eb-4a0f-8dc1-566d038e4a96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d] added
Apr 13 21:47:41 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3f73a1-686e-4215-92d3-fb52fc85baf6]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b954bf-26d7-4fad-a72d-89323bdcc640]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LmxrBWHe {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LmxrBWHe" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[225c175f-bcaa-411a-9ab3-7a746dab5734]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LmxrBWHe'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4d9213-75d8-4336-a6b2-afeb4d6b025b]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[873f3a17-6831-4a11-9257-7f8159b84637]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:41 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:41 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:41 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:41 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3518cb5e-0a02-476b-88cf-e7a633a3a4fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d, portal: 172.16.0.220,3260]
Apr 13 21:47:41 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d, portal: 172.16.0.220,3260] successful.
Apr 13 21:47:41 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[61af2ab8-8cd7-4dc0-ad2f-4331938002f8]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b442307b-20b9-434e-a2f8-87cef7964933]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:41 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:41 user nova-compute[71325]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)
Apr 13 21:47:41 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:41 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:41 user nova-compute[71325]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)
Apr 13 21:47:41 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c2e560-f1d7-4062-9605-5668445f8964]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:47:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmxrBWHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:47:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23163326431323235', 'path': '/dev/sdd'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163326431323235', 'path': '/dev/sdd'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:47:42 user nova-compute[71325]: DEBUG nova.objects.instance [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lazy-loading 'flavor' on Instance uuid be81f393-654b-4b50-856e-00818f3ae59e {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:47:42 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:47:42 user nova-compute[71325]:   <source dev="/dev/sdd"/>
Apr 13 21:47:42 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:47:42 user nova-compute[71325]:   <serial>14774bd1-7eae-45fb-adfc-31c4d866a06d</serial>
Apr 13 21:47:42 user nova-compute[71325]: </disk>
Apr 13 21:47:42 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] No VIF found with MAC fa:16:3e:02:59:10, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "be81f393-654b-4b50-856e-00818f3ae59e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.645s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbKuIFqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:43 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:43 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:43 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b37ca6-0eec-4773-b045-3b378e46a850]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:47:43 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[050a8d8d-4426-473e-8421-6583b09f38e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da] added
Apr 13 21:47:43 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2de0d6-7991-4ee3-9c82-7662838974d1]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.154s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a3c7d5-cd34-4203-b775-d909754e92d9]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbKuIFqs {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbKuIFqs" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7205a82-9583-40fd-85f1-6efc9f5e09fe]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MbKuIFqs'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dde8f2-e47d-4f10-a584-84f650fc92e9]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecefefa8-5534-4df4-ae62-e025204d2c04]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:43 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:43 user nova-compute[71325]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)
Apr 13 21:47:43 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:43 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:43 user nova-compute[71325]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)
Apr 13 21:47:43 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-a0835d53-1e49-49b9-a096-6257ec9daaaa req-49c42793-7eb8-401d-89d0-804317f82d98 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received event network-changed-8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-a0835d53-1e49-49b9-a096-6257ec9daaaa req-49c42793-7eb8-401d-89d0-804317f82d98 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Refreshing instance network info cache due to event network-changed-8c222f8e-f61d-4b04-87c4-edd1ca83b22b. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a0835d53-1e49-49b9-a096-6257ec9daaaa req-49c42793-7eb8-401d-89d0-804317f82d98 service nova] Acquiring lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a0835d53-1e49-49b9-a096-6257ec9daaaa req-49c42793-7eb8-401d-89d0-804317f82d98 service nova] Acquired lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG nova.network.neutron [req-a0835d53-1e49-49b9-a096-6257ec9daaaa req-49c42793-7eb8-401d-89d0-804317f82d98 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Refreshing network info cache for port 8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f609a6d-1a40-4534-b65d-7a819dd7f3bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da, portal: 172.16.0.220,3260]
Apr 13 21:47:43 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da, portal: 172.16.0.220,3260] successful.
Apr 13 21:47:43 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c38ffb5-f373-4089-b436-423280c57345]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9388ad41-5b50-4b7d-a88e-3c5eb9e1805d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:43 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:43 user nova-compute[71325]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)
Apr 13 21:47:43 user nova-compute[71325]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)
Apr 13 21:47:43 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:43 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:43 user nova-compute[71325]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)
Apr 13 21:47:43 user nova-compute[71325]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)
Apr 13 21:47:43 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.470s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6157d052-0bdf-441a-8113-e7d566f5adbf]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:47:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbKuIFqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "interface-ff61d99e-4db9-421f-8c01-264a7278c095-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "interface-ff61d99e-4db9-421f-8c01-264a7278c095-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG nova.objects.instance [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lazy-loading 'flavor' on Instance uuid ff61d99e-4db9-421f-8c01-264a7278c095 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG nova.network.neutron [req-a0835d53-1e49-49b9-a096-6257ec9daaaa req-49c42793-7eb8-401d-89d0-804317f82d98 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Updated VIF entry in instance network info cache for port 8c222f8e-f61d-4b04-87c4-edd1ca83b22b. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG nova.network.neutron [req-a0835d53-1e49-49b9-a096-6257ec9daaaa req-49c42793-7eb8-401d-89d0-804317f82d98 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Updating instance_info_cache with network_info: [{"id": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "address": "fa:16:3e:a2:5a:69", "network": {"id": "887fc8b4-07a7-4f28-8a55-c09dc080941e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-632369901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c222f8e-f6", "ovs_interfaceid": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG nova.objects.instance [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lazy-loading 'pci_requests' on Instance uuid ff61d99e-4db9-421f-8c01-264a7278c095 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a0835d53-1e49-49b9-a096-6257ec9daaaa req-49c42793-7eb8-401d-89d0-804317f82d98 service nova] Releasing lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG nova.policy [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18587f4671a34f568e00dbee3f33eb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd0897baf2c455c87ac9a330a673d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "be81f393-654b-4b50-856e-00818f3ae59e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "be81f393-654b-4b50-856e-00818f3ae59e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:44 user nova-compute[71325]: INFO nova.compute.manager [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Detaching volume 14774bd1-7eae-45fb-adfc-31c4d866a06d
Apr 13 21:47:44 user nova-compute[71325]: INFO nova.virt.block_device [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Attempting to driver detach volume 14774bd1-7eae-45fb-adfc-31c4d866a06d from mountpoint /dev/vdb
Apr 13 21:47:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.502s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] <== connect_volume: return (1503ms) {'type': 'block', 'scsi_wwn': '23239643161336538', 'path': '/dev/sde'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239643161336538', 'path': '/dev/sde'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Attempting to detach device vdb from instance be81f393-654b-4b50-856e-00818f3ae59e from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:47:44 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:47:44 user nova-compute[71325]:   <source dev="/dev/sdd"/>
Apr 13 21:47:44 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:47:44 user nova-compute[71325]:   <serial>14774bd1-7eae-45fb-adfc-31c4d866a06d</serial>
Apr 13 21:47:44 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:47:44 user nova-compute[71325]: </disk>
Apr 13 21:47:44 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG nova.objects.instance [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lazy-loading 'flavor' on Instance uuid c71cb46d-2737-4b94-8159-267ea4a0a296 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:44 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Successfully detached device vdb from instance be81f393-654b-4b50-856e-00818f3ae59e from the persistent domain config.
Apr 13 21:47:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be81f393-654b-4b50-856e-00818f3ae59e from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:47:44 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:47:44 user nova-compute[71325]:   <source dev="/dev/sdd"/>
Apr 13 21:47:44 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:47:44 user nova-compute[71325]:   <serial>14774bd1-7eae-45fb-adfc-31c4d866a06d</serial>
Apr 13 21:47:44 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:47:44 user nova-compute[71325]: </disk>
Apr 13 21:47:44 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:47:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:47:44 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:47:44 user nova-compute[71325]:   <source dev="/dev/sde"/>
Apr 13 21:47:44 user nova-compute[71325]:   <target dev="sdc" bus="scsi"/>
Apr 13 21:47:44 user nova-compute[71325]:   <serial>ec590b36-5a34-4473-be50-d525f384e5da</serial>
Apr 13 21:47:44 user nova-compute[71325]:   <address type="drive" controller="0" unit="2"/>
Apr 13 21:47:44 user nova-compute[71325]: </disk>
Apr 13 21:47:44 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Successfully created port: 30cd1e3e-0642-43d5-816d-210deb9ace23 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] No BDM found with device name sda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] No VIF found with MAC fa:16:3e:70:87:1e, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.775s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681422465.5996592, be81f393-654b-4b50-856e-00818f3ae59e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be81f393-654b-4b50-856e-00818f3ae59e {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQpZxYWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '35820c1d-307d-43ed-b3d1-31fe12602870', 'attached_at': '', 'detached_at': '', 'volume_id': '232f1088-3899-4c7b-afcb-b2847abf5b27', 'serial': '232f1088-3899-4c7b-afcb-b2847abf5b27'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoQMDOWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '35820c1d-307d-43ed-b3d1-31fe12602870', 'attached_at': '', 'detached_at': '', 'volume_id': '36939113-535a-44e7-a3b9-f81c95e278c4', 'serial'} {{(pid=71325) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 13 21:47:45 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Successfully detached device vdb from instance be81f393-654b-4b50-856e-00818f3ae59e from the live domain config.
Apr 13 21:47:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQpZxYWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:45 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:45 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:45 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:47:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmxrBWHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:45 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be43572-abcf-4c9d-8919-c526eecc7d73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:47:45 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[883d7eff-0700-45ec-968a-89bde3465887]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27] added
Apr 13 21:47:45 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0821bd23-f4ee-4e02-9987-0bee5188731a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e7d85f-1a72-42e2-b5a6-c2fba61aed1c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQpZxYWf {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQpZxYWf" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d57100e-3814-4055-9078-1b50ce1275eb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQpZxYWf'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faa0bf6-2882-4543-b28b-387cc848f6a6]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f73d33-a6d8-4dc0-a7ba-ef734bddda23]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:45 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:45 user nova-compute[71325]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)
Apr 13 21:47:45 user nova-compute[71325]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)
Apr 13 21:47:45 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:45 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:45 user nova-compute[71325]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)
Apr 13 21:47:45 user nova-compute[71325]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)
Apr 13 21:47:45 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Successfully updated port: 30cd1e3e-0642-43d5-816d-210deb9ace23 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquired lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG nova.compute.manager [req-9e41953d-a0f7-4023-9fd3-394b8798cf94 req-d8e45156-7850-48e6-80fa-01d20c8fa785 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received event network-changed-30cd1e3e-0642-43d5-816d-210deb9ace23 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG nova.compute.manager [req-9e41953d-a0f7-4023-9fd3-394b8798cf94 req-d8e45156-7850-48e6-80fa-01d20c8fa785 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Refreshing instance network info cache due to event network-changed-30cd1e3e-0642-43d5-816d-210deb9ace23. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9e41953d-a0f7-4023-9fd3-394b8798cf94 req-d8e45156-7850-48e6-80fa-01d20c8fa785 service nova] Acquiring lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b859ce4-364d-4d61-b24d-fffb3b873f99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27, portal: 172.16.0.220,3260]
Apr 13 21:47:45 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27, portal: 172.16.0.220,3260] successful.
Apr 13 21:47:45 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[211760c9-5ef2-4c09-8bb3-343ea1b17dbc]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d973b2-11c1-4184-b555-844d8aaf2b2f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:45 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:45 user nova-compute[71325]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)
Apr 13 21:47:45 user nova-compute[71325]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)
Apr 13 21:47:45 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:47:45 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:45 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:45 user nova-compute[71325]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)
Apr 13 21:47:45 user nova-compute[71325]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)
Apr 13 21:47:45 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:47:45 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7a8b69-9db9-4e2d-977a-6fa3d91c67e9]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:47:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQpZxYWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Updating instance_info_cache with network_info: [{"id": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "address": "fa:16:3e:a2:5a:69", "network": {"id": "887fc8b4-07a7-4f28-8a55-c09dc080941e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-632369901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c222f8e-f6", "ovs_interfaceid": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30cd1e3e-0642-43d5-816d-210deb9ace23", "address": "fa:16:3e:45:57:fe", "network": {"id": "ef33d497-2e44-4569-80c1-86dfb7a13837", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-439692832", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30cd1e3e-06", "ovs_interfaceid": "30cd1e3e-0642-43d5-816d-210deb9ace23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Releasing lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9e41953d-a0f7-4023-9fd3-394b8798cf94 req-d8e45156-7850-48e6-80fa-01d20c8fa785 service nova] Acquired lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.network.neutron [req-9e41953d-a0f7-4023-9fd3-394b8798cf94 req-d8e45156-7850-48e6-80fa-01d20c8fa785 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Refreshing network info cache for port 30cd1e3e-0642-43d5-816d-210deb9ace23 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-155987669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-155987669',id=11,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv5A5QM89WDKnsULhMuooVL+m28bgPV7OihZIzGssK7PgLTiXl/GrJAAaMRdz+PYZbhzGzt+oX5wWpDIz3NkiaY2vLH+14jBnJVm8Ym0U0jNo9V6zKnqyN1OlYdbXBS3Q==',key_name='tempest-keypair-1492294196',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fd0897baf2c455c87ac9a330a673d8e',ramdisk_id='',reservation_id='r-jqdpikg2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1835832502',owner_user_name='tempest-TaggedAttachmentsTest-1835832502-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18587f4671a34f568e00dbee3f33eb8b',uuid=ff61d99e-4db9-421f-8c01-264a7278c095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30cd1e3e-0642-43d5-816d-210deb9ace23", "address": "fa:16:3e:45:57:fe", "network": {"id": "ef33d497-2e44-4569-80c1-86dfb7a13837", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-439692832", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30cd1e3e-06", "ovs_interfaceid": "30cd1e3e-0642-43d5-816d-210deb9ace23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Converting VIF {"id": "30cd1e3e-0642-43d5-816d-210deb9ace23", "address": "fa:16:3e:45:57:fe", "network": {"id": "ef33d497-2e44-4569-80c1-86dfb7a13837", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-439692832", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30cd1e3e-06", "ovs_interfaceid": "30cd1e3e-0642-43d5-816d-210deb9ace23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=30cd1e3e-0642-43d5-816d-210deb9ace23,network=Network(ef33d497-2e44-4569-80c1-86dfb7a13837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30cd1e3e-06') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG os_vif [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=30cd1e3e-0642-43d5-816d-210deb9ace23,network=Network(ef33d497-2e44-4569-80c1-86dfb7a13837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30cd1e3e-06') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30cd1e3e-06, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30cd1e3e-06, col_values=(('external_ids', {'iface-id': '30cd1e3e-0642-43d5-816d-210deb9ace23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:57:fe', 'vm-uuid': 'ff61d99e-4db9-421f-8c01-264a7278c095'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:46 user nova-compute[71325]: INFO os_vif [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=30cd1e3e-0642-43d5-816d-210deb9ace23,network=Network(ef33d497-2e44-4569-80c1-86dfb7a13837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30cd1e3e-06')
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-155987669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-155987669',id=11,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv5A5QM89WDKnsULhMuooVL+m28bgPV7OihZIzGssK7PgLTiXl/GrJAAaMRdz+PYZbhzGzt+oX5wWpDIz3NkiaY2vLH+14jBnJVm8Ym0U0jNo9V6zKnqyN1OlYdbXBS3Q==',key_name='tempest-keypair-1492294196',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fd0897baf2c455c87ac9a330a673d8e',ramdisk_id='',reservation_id='r-jqdpikg2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1835832502',owner_user_name='tempest-TaggedAttachmentsTest-1835832502-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18587f4671a34f568e00dbee3f33eb8b',uuid=ff61d99e-4db9-421f-8c01-264a7278c095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30cd1e3e-0642-43d5-816d-210deb9ace23", "address": "fa:16:3e:45:57:fe", "network": {"id": "ef33d497-2e44-4569-80c1-86dfb7a13837", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-439692832", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30cd1e3e-06", "ovs_interfaceid": "30cd1e3e-0642-43d5-816d-210deb9ace23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Converting VIF {"id": "30cd1e3e-0642-43d5-816d-210deb9ace23", "address": "fa:16:3e:45:57:fe", "network": {"id": "ef33d497-2e44-4569-80c1-86dfb7a13837", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-439692832", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30cd1e3e-06", "ovs_interfaceid": "30cd1e3e-0642-43d5-816d-210deb9ace23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=30cd1e3e-0642-43d5-816d-210deb9ace23,network=Network(ef33d497-2e44-4569-80c1-86dfb7a13837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30cd1e3e-06') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] attach device xml: <interface type="ethernet">
Apr 13 21:47:46 user nova-compute[71325]:   <mac address="fa:16:3e:45:57:fe"/>
Apr 13 21:47:46 user nova-compute[71325]:   <model type="virtio"/>
Apr 13 21:47:46 user nova-compute[71325]:   <mtu size="1442"/>
Apr 13 21:47:46 user nova-compute[71325]:   <target dev="tap30cd1e3e-06"/>
Apr 13 21:47:46 user nova-compute[71325]: </interface>
Apr 13 21:47:46 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "c71cb46d-2737-4b94-8159-267ea4a0a296" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:46 user nova-compute[71325]: INFO nova.compute.manager [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Detaching volume ec590b36-5a34-4473-be50-d525f384e5da
Apr 13 21:47:46 user nova-compute[71325]: INFO nova.virt.block_device [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Attempting to driver detach volume ec590b36-5a34-4473-be50-d525f384e5da from mountpoint /dev/sdc
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Attempting to detach device sdc from instance c71cb46d-2737-4b94-8159-267ea4a0a296 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:47:46 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:47:46 user nova-compute[71325]:   <source dev="/dev/sde"/>
Apr 13 21:47:46 user nova-compute[71325]:   <target dev="sdc" bus="scsi"/>
Apr 13 21:47:46 user nova-compute[71325]:   <serial>ec590b36-5a34-4473-be50-d525f384e5da</serial>
Apr 13 21:47:46 user nova-compute[71325]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 13 21:47:46 user nova-compute[71325]: </disk>
Apr 13 21:47:46 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26265373331636466', 'path': '/dev/sdf'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265373331636466', 'path': '/dev/sdf'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.327s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:46 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Successfully detached device sdc from instance c71cb46d-2737-4b94-8159-267ea4a0a296 from the persistent domain config.
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance c71cb46d-2737-4b94-8159-267ea4a0a296 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:47:46 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:47:46 user nova-compute[71325]:   <source dev="/dev/sde"/>
Apr 13 21:47:46 user nova-compute[71325]:   <target dev="sdc" bus="scsi"/>
Apr 13 21:47:46 user nova-compute[71325]:   <serial>ec590b36-5a34-4473-be50-d525f384e5da</serial>
Apr 13 21:47:46 user nova-compute[71325]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 13 21:47:46 user nova-compute[71325]: </disk>
Apr 13 21:47:46 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lazy-loading 'flavor' on Instance uuid 35820c1d-307d-43ed-b3d1-31fe12602870 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc80483-cf94-4cf5-8185-abe146348985]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:47:46 user nova-compute[71325]: No targets found.
Apr 13 21:47:46 user nova-compute[71325]: iSNS:
Apr 13 21:47:46 user nova-compute[71325]: No targets found.
Apr 13 21:47:46 user nova-compute[71325]: STATIC:
Apr 13 21:47:46 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27
Apr 13 21:47:46 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:46 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:46 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae
Apr 13 21:47:46 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:46 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:46 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d
Apr 13 21:47:46 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:46 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:46 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da
Apr 13 21:47:46 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:46 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:46 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4
Apr 13 21:47:46 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:46 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:46 user nova-compute[71325]: FIRMWARE:
Apr 13 21:47:46 user nova-compute[71325]: No targets found.
Apr 13 21:47:46 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:47:46 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:47:46 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:47:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ae7708-06eb-4a22-97c1-6924d0ad3a4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] No BDM found with device name hda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] No VIF found with MAC fa:16:3e:a2:5a:69, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e68f759-f96d-4dc8-96a9-854bc0cd50a3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.network.neutron [req-9e41953d-a0f7-4023-9fd3-394b8798cf94 req-d8e45156-7850-48e6-80fa-01d20c8fa785 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Updated VIF entry in instance network info cache for port 30cd1e3e-0642-43d5-816d-210deb9ace23. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.network.neutron [req-9e41953d-a0f7-4023-9fd3-394b8798cf94 req-d8e45156-7850-48e6-80fa-01d20c8fa785 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Updating instance_info_cache with network_info: [{"id": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "address": "fa:16:3e:a2:5a:69", "network": {"id": "887fc8b4-07a7-4f28-8a55-c09dc080941e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-632369901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c222f8e-f6", "ovs_interfaceid": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30cd1e3e-0642-43d5-816d-210deb9ace23", "address": "fa:16:3e:45:57:fe", "network": {"id": "ef33d497-2e44-4569-80c1-86dfb7a13837", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-439692832", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30cd1e3e-06", "ovs_interfaceid": "30cd1e3e-0642-43d5-816d-210deb9ace23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:47 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:47 user nova-compute[71325]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)
Apr 13 21:47:47 user nova-compute[71325]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)
Apr 13 21:47:47 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:47:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:47 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:47 user nova-compute[71325]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d (non-flash)
Apr 13 21:47:47 user nova-compute[71325]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)
Apr 13 21:47:47 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:47:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c46979a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d'): ({'sdd'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Removing single pathed devices sdd {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9e41953d-a0f7-4023-9fd3-394b8798cf94 req-d8e45156-7850-48e6-80fa-01d20c8fa785 service nova] Releasing lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:47:47 user nova-compute[71325]:   <nova:package version="0.0.0"/>
Apr 13 21:47:47 user nova-compute[71325]:   <nova:name>tempest-device-tagging-server-155987669</nova:name>
Apr 13 21:47:47 user nova-compute[71325]:   <nova:creationTime>2023-04-13 21:47:47</nova:creationTime>
Apr 13 21:47:47 user nova-compute[71325]:   <nova:flavor name="m1.nano">
Apr 13 21:47:47 user nova-compute[71325]:     <nova:memory>128</nova:memory>
Apr 13 21:47:47 user nova-compute[71325]:     <nova:disk>1</nova:disk>
Apr 13 21:47:47 user nova-compute[71325]:     <nova:swap>0</nova:swap>
Apr 13 21:47:47 user nova-compute[71325]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:47:47 user nova-compute[71325]:     <nova:vcpus>1</nova:vcpus>
Apr 13 21:47:47 user nova-compute[71325]:   </nova:flavor>
Apr 13 21:47:47 user nova-compute[71325]:   <nova:owner>
Apr 13 21:47:47 user nova-compute[71325]:     <nova:user uuid="18587f4671a34f568e00dbee3f33eb8b">tempest-TaggedAttachmentsTest-1835832502-project-member</nova:user>
Apr 13 21:47:47 user nova-compute[71325]:     <nova:project uuid="2fd0897baf2c455c87ac9a330a673d8e">tempest-TaggedAttachmentsTest-1835832502</nova:project>
Apr 13 21:47:47 user nova-compute[71325]:   </nova:owner>
Apr 13 21:47:47 user nova-compute[71325]:   <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:47:47 user nova-compute[71325]:   <nova:ports>
Apr 13 21:47:47 user nova-compute[71325]:     <nova:port uuid="8c222f8e-f61d-4b04-87c4-edd1ca83b22b">
Apr 13 21:47:47 user nova-compute[71325]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 21:47:47 user nova-compute[71325]:     </nova:port>
Apr 13 21:47:47 user nova-compute[71325]:     <nova:port uuid="30cd1e3e-0642-43d5-816d-210deb9ace23">
Apr 13 21:47:47 user nova-compute[71325]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Apr 13 21:47:47 user nova-compute[71325]:     </nova:port>
Apr 13 21:47:47 user nova-compute[71325]:   </nova:ports>
Apr 13 21:47:47 user nova-compute[71325]: </nova:instance>
Apr 13 21:47:47 user nova-compute[71325]:  {{(pid=71325) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2354015-63d7-4b55-9069-414ab312bb91]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "interface-ff61d99e-4db9-421f-8c01-264a7278c095-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.050s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[671a42fe-330a-4fe6-9d59-ffcc0a5570ea]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Flushing IO for device /dev/sdd {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53d2662-5b6a-42f0-b476-1a1853f991e6]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0db327-3fc3-45fa-9e5b-4b21c8ee05e6]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] SCSI volumes sdd have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba23aa8-6a40-4575-887b-69d8073fbb95]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ba8ea0-cc36-4705-a333-04b7a9d47b75]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d, portal: 172.16.0.220,3260]
Apr 13 21:47:47 user nova-compute[71325]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d, portal: 172.16.0.220,3260] successful.
Apr 13 21:47:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14774bd1-7eae-45fb-adfc-31c4d866a06d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f98613e-a055-4ce2-8717-b088510aea17]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] <== disconnect_volume: return (1711ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "ff61d99e-4db9-421f-8c01-264a7278c095" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "ff61d99e-4db9-421f-8c01-264a7278c095" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lazy-loading 'flavor' on Instance uuid ff61d99e-4db9-421f-8c01-264a7278c095 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681422467.3743026, c71cb46d-2737-4b94-8159-267ea4a0a296 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance c71cb46d-2737-4b94-8159-267ea4a0a296 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:47:47 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Successfully detached device sdc from instance c71cb46d-2737-4b94-8159-267ea4a0a296 from the live domain config.
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbKuIFqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:47 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "ff61d99e-4db9-421f-8c01-264a7278c095" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e2d4be-60c3-4887-8bce-75ff9e1ab443]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:47:47 user nova-compute[71325]: No targets found.
Apr 13 21:47:47 user nova-compute[71325]: iSNS:
Apr 13 21:47:47 user nova-compute[71325]: No targets found.
Apr 13 21:47:47 user nova-compute[71325]: STATIC:
Apr 13 21:47:47 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27
Apr 13 21:47:47 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:47 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:47 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae
Apr 13 21:47:47 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:47 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:47 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da
Apr 13 21:47:47 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:47 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:47 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4
Apr 13 21:47:47 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:47 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:47 user nova-compute[71325]: FIRMWARE:
Apr 13 21:47:47 user nova-compute[71325]: No targets found.
Apr 13 21:47:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:47:47 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:47:47 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[969f517b-eed4-4dc9-973c-18a357c13206]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d693d6-3d83-4b31-905f-44caba6c1af9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:47 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:47 user nova-compute[71325]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)
Apr 13 21:47:47 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:47:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:47 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:47 user nova-compute[71325]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da (non-flash)
Apr 13 21:47:47 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:47:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5cc1488b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da'): ({'sde'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Removing single pathed devices sde {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c93ece4-83b7-4307-abb0-62cb8f53b9e4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c86ccb-c0ae-4ec8-9b39-bb4ceedf58ef]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Flushing IO for device /dev/sde {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "ff61d99e-4db9-421f-8c01-264a7278c095" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "ff61d99e-4db9-421f-8c01-264a7278c095" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:47 user nova-compute[71325]: INFO nova.compute.manager [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Attaching volume 68f18b86-11cf-4281-8970-f6f9abe4ea96 to /dev/vdb
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e87240-3e44-4f7d-aceb-e7cc402bb00b]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[046446a7-0471-43b0-80ec-e21fb110c0a5]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] SCSI volumes sde have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.utils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8029b054-3cfe-41ab-bf25-20e5e6929f6e]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d392bd-4749-42c9-8ecf-57cd11304f7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2637b792-4bef-4bd9-9eef-1dcd648ef2fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ed102e-2cdc-46f9-86e5-b73f5f076e6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c5251b-4ec3-499c-8198-1b93e61a8873]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[66433a20-b655-4238-be5a-f0b6ec4a1216]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da, portal: 172.16.0.220,3260]
Apr 13 21:47:47 user nova-compute[71325]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da, portal: 172.16.0.220,3260] successful.
Apr 13 21:47:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:47 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd95c56-8518-45e8-a1e4-71812b543dd1]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.utils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Updating existing volume attachment record: d482a3cd-7e3a-4900-85aa-559d0d4c7b3f {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec590b36-5a34-4473-be50-d525f384e5da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c86746a-c624-4f11-a934-d2dc7563cddf]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] <== disconnect_volume: return (420ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received event network-vif-plugged-30cd1e3e-0642-43d5-816d-210deb9ace23 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] Acquiring lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] No waiting events found dispatching network-vif-plugged-30cd1e3e-0642-43d5-816d-210deb9ace23 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:47 user nova-compute[71325]: WARNING nova.compute.manager [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received unexpected event network-vif-plugged-30cd1e3e-0642-43d5-816d-210deb9ace23 for instance with vm_state active and task_state None.
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received event network-vif-plugged-30cd1e3e-0642-43d5-816d-210deb9ace23 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] Acquiring lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] No waiting events found dispatching network-vif-plugged-30cd1e3e-0642-43d5-816d-210deb9ace23 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:47 user nova-compute[71325]: WARNING nova.compute.manager [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received unexpected event network-vif-plugged-30cd1e3e-0642-43d5-816d-210deb9ace23 for instance with vm_state active and task_state None.
Apr 13 21:47:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 100663296 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 100663296 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 100663296 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 101711872 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:49 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lazy-loading 'flavor' on Instance uuid be81f393-654b-4b50-856e-00818f3ae59e {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "be81f393-654b-4b50-856e-00818f3ae59e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.088s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 210763776 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:50 user nova-compute[71325]: DEBUG nova.objects.instance [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lazy-loading 'flavor' on Instance uuid c71cb46d-2737-4b94-8159-267ea4a0a296 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.902s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 322961408 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 466616320 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "c71cb46d-2737-4b94-8159-267ea4a0a296" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:51 user nova-compute[71325]: INFO nova.compute.manager [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Terminating instance
Apr 13 21:47:51 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 612368384 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-d6ef06c5-5a73-4545-a045-c590e02de1e9 req-cb55344c-0ebb-44f5-90c2-f7126a912e92 service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Received event network-vif-unplugged-3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d6ef06c5-5a73-4545-a045-c590e02de1e9 req-cb55344c-0ebb-44f5-90c2-f7126a912e92 service nova] Acquiring lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d6ef06c5-5a73-4545-a045-c590e02de1e9 req-cb55344c-0ebb-44f5-90c2-f7126a912e92 service nova] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d6ef06c5-5a73-4545-a045-c590e02de1e9 req-cb55344c-0ebb-44f5-90c2-f7126a912e92 service nova] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-d6ef06c5-5a73-4545-a045-c590e02de1e9 req-cb55344c-0ebb-44f5-90c2-f7126a912e92 service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] No waiting events found dispatching network-vif-unplugged-3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-d6ef06c5-5a73-4545-a045-c590e02de1e9 req-cb55344c-0ebb-44f5-90c2-f7126a912e92 service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Received event network-vif-unplugged-3a5a1230-3352-4342-80b2-5c87991a9b3d for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:47:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 737148928 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Instance destroyed successfully.
Apr 13 21:47:52 user nova-compute[71325]: DEBUG nova.objects.instance [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lazy-loading 'resources' on Instance uuid c71cb46d-2737-4b94-8159-267ea4a0a296 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:45:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1482021877',display_name='tempest-AttachSCSIVolumeTestJSON-server-1482021877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1482021877',id=10,image_ref='dda98d66-c12c-4e6c-8424-49468954423b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFROVO+zm7q7MfconxyMxDki9e01Easmw29VJ/VqS+XvT8Z0ODRB772cwRCD/oqQmD8w9y32x+8FkKd6/URareT0Tt2jFEa6d7Cczm3AP49Fa7ACviOhVHEiiknpYk8Ig==',key_name='tempest-keypair-370819211',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ddcd2da3f5e4a148bef3c7c4adce6db',ramdisk_id='',reservation_id='r-izjeaxxx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dda98d66-c12c-4e6c-8424-49468954423b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-499777998',owner_user_name='tempest-AttachSCSIVolumeTestJSON-499777998-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:45:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acd1c71dac2c4f2a810c2f4a6883fde9',uuid=c71cb46d-2737-4b94-8159-267ea4a0a296,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "address": "fa:16:3e:70:87:1e", "network": {"id": "b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1362663481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddcd2da3f5e4a148bef3c7c4adce6db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5a1230-33", "ovs_interfaceid": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:47:52 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Converting VIF {"id": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "address": "fa:16:3e:70:87:1e", "network": {"id": "b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1362663481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddcd2da3f5e4a148bef3c7c4adce6db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5a1230-33", "ovs_interfaceid": "3a5a1230-3352-4342-80b2-5c87991a9b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:47:52 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:87:1e,bridge_name='br-int',has_traffic_filtering=True,id=3a5a1230-3352-4342-80b2-5c87991a9b3d,network=Network(b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5a1230-33') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:47:52 user nova-compute[71325]: DEBUG os_vif [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:87:1e,bridge_name='br-int',has_traffic_filtering=True,id=3a5a1230-3352-4342-80b2-5c87991a9b3d,network=Network(b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5a1230-33') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:47:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a5a1230-33, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:47:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:47:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:52 user nova-compute[71325]: INFO os_vif [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:87:1e,bridge_name='br-int',has_traffic_filtering=True,id=3a5a1230-3352-4342-80b2-5c87991a9b3d,network=Network(b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5a1230-33')
Apr 13 21:47:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Deleting instance files /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296_del
Apr 13 21:47:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Deletion of /opt/stack/data/nova/instances/c71cb46d-2737-4b94-8159-267ea4a0a296_del complete
Apr 13 21:47:52 user nova-compute[71325]: INFO nova.compute.manager [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 13 21:47:52 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:47:52 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:47:52 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:47:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 844103680 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 974127104 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:47:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:47:53 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoQMDOWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:53 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:53 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:53 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-49710e9c-8f25-4dfc-b540-37b9e1abab1a req-96e097e4-8ef4-4875-9e5b-84f3bfdfad98 service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Received event network-vif-plugged-3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49710e9c-8f25-4dfc-b540-37b9e1abab1a req-96e097e4-8ef4-4875-9e5b-84f3bfdfad98 service nova] Acquiring lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49710e9c-8f25-4dfc-b540-37b9e1abab1a req-96e097e4-8ef4-4875-9e5b-84f3bfdfad98 service nova] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49710e9c-8f25-4dfc-b540-37b9e1abab1a req-96e097e4-8ef4-4875-9e5b-84f3bfdfad98 service nova] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-49710e9c-8f25-4dfc-b540-37b9e1abab1a req-96e097e4-8ef4-4875-9e5b-84f3bfdfad98 service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] No waiting events found dispatching network-vif-plugged-3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:47:54 user nova-compute[71325]: WARNING nova.compute.manager [req-49710e9c-8f25-4dfc-b540-37b9e1abab1a req-96e097e4-8ef4-4875-9e5b-84f3bfdfad98 service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Received unexpected event network-vif-plugged-3a5a1230-3352-4342-80b2-5c87991a9b3d for instance with vm_state active and task_state deleting.
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[789eaf05-89ef-4b7b-983a-fbfb433dfc24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:47:54 user nova-compute[71325]: No targets found.
Apr 13 21:47:54 user nova-compute[71325]: iSNS:
Apr 13 21:47:54 user nova-compute[71325]: No targets found.
Apr 13 21:47:54 user nova-compute[71325]: STATIC:
Apr 13 21:47:54 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27
Apr 13 21:47:54 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:54 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:54 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae
Apr 13 21:47:54 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:54 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:54 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4
Apr 13 21:47:54 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:54 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:54 user nova-compute[71325]: FIRMWARE:
Apr 13 21:47:54 user nova-compute[71325]: No targets found.
Apr 13 21:47:54 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:47:54 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:47:54 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6067e444-cc3e-471d-a3e0-c84e77737c95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5457ade3-5cf2-4664-905e-31f4a7ee3f08]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:54 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:54 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:47:54 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:54 user nova-compute[71325]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:47:54 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:47:54 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7ebec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4'): ({'sdc'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Removing single pathed devices sdc {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:47:54 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Took 1.58 seconds to deallocate network for instance.
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-eab4cab0-ce3d-42a7-b73d-838ab7bca5f2 req-de38ce43-9695-41c2-8cd5-c6488b2bc6c0 service nova] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Received event network-vif-deleted-3a5a1230-3352-4342-80b2-5c87991a9b3d {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[570fe8c7-5fe0-405d-8c06-98ddfc8b82da]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6f131b-c920-4286-b16a-f4a491003027]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Flushing IO for device /dev/sdc {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e62579a-a77e-4c0e-8616-6bb99e558b7a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[128980b7-2a78-4251-a74d-db190661ae86]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a98c1c-7e5b-4846-a9bd-38c7a8b2d06c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[625c8819-6d6c-4fbd-b2e7-5d06739f1813]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260]
Apr 13 21:47:54 user nova-compute[71325]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260] successful.
Apr 13 21:47:54 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd94b4b-a1b8-406c-aa50-43a60bd76c81]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] <== disconnect_volume: return (342ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQpZxYWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '35820c1d-307d-43ed-b3d1-31fe12602870', 'attached_at': '', 'detached_at': '', 'volume_id': '232f1088-3899-4c7b-afcb-b2847abf5b27', 'serial'} {{(pid=71325) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] swap_volume: removing Cinder connection for volume 36939113-535a-44e7-a3b9-f81c95e278c4 {{(pid=71325) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:54 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Deleted allocations for instance c71cb46d-2737-4b94-8159-267ea4a0a296
Apr 13 21:47:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "c71cb46d-2737-4b94-8159-267ea4a0a296" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.164s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iyNYoFVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:55 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:55 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:55 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] swap_volume: Updating volume 36939113-535a-44e7-a3b9-f81c95e278c4 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "eQpZxYWf", "auth_password": "Vay2WUZAEROocG", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "232f1088-3899-4c7b-afcb-b2847abf5b27"}, "status": "reserved", "instance": "35820c1d-307d-43ed-b3d1-31fe12602870", "attached_at": "", "detached_at": "", "volume_id": "232f1088-3899-4c7b-afcb-b2847abf5b27", "serial": "232f1088-3899-4c7b-afcb-b2847abf5b27"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '232f1088-3899-4c7b-afcb-b2847abf5b27', 'no_device': None, 'attachment_id': 'dc59e211-f218-4024-8bdd-6a152d2b2d7c'} {{(pid=71325) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea89b3e-7ffe-4f6a-b389-69a91fb4ea32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:47:55 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "35820c1d-307d-43ed-b3d1-31fe12602870" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.531s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b0ec15-f2ca-4ffd-8756-c2dc15c41eaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96] added
Apr 13 21:47:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3cf2e4-c9bd-439d-9072-503621ce027c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da73ed4-d261-40e0-b5e2-d89403e06686]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iyNYoFVg {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iyNYoFVg" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[446168f9-5b5b-41f8-b900-82d88d31e2ed]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iyNYoFVg'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ce8be6-9b5d-4139-8394-0104ef33a111]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4694d1-cd65-4551-9cc6-2d20f783d6d6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:55 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:47:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:55 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:47:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae660b3-400d-45e8-96ee-fbc24aed85a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96, portal: 172.16.0.220,3260]
Apr 13 21:47:55 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96, portal: 172.16.0.220,3260] successful.
Apr 13 21:47:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c74c4f-efec-40aa-bcf0-65a1378933aa]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7a747e-b58d-4989-bf09-e79adf22a071]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:55 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:47:55 user nova-compute[71325]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 (non-flash)
Apr 13 21:47:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:55 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:47:55 user nova-compute[71325]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 (non-flash)
Apr 13 21:47:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] HCTL ('34', '-', '-', 0) found on session 8 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8809c122-d5a2-4a8e-9589-20db35bdceeb]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Searching for a device in session 8 and hctl ['34', '*', '*', 0] yield: None {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Acquiring lock "35820c1d-307d-43ed-b3d1-31fe12602870" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "35820c1d-307d-43ed-b3d1-31fe12602870" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG os_brick.utils [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[78db8d8c-5b5c-4686-8da9-7bc3a17d80ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1167104b-7f0c-402f-85e1-be5c40cefc5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d023c8f-2ad5-47e2-9b21-58526de4cda6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6846b4-26a8-458c-b3c0-661c001d9560]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:47:56 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:47:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df2c1e-c412-4409-b3a1-cd1e54ac024c]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG os_brick.utils [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:56 user nova-compute[71325]: INFO nova.compute.manager [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Swapping volume 232f1088-3899-4c7b-afcb-b2847abf5b27 for 36939113-535a-44e7-a3b9-f81c95e278c4
Apr 13 21:47:56 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Searching for a device in session 8 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iyNYoFVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26665643566366330', 'path': '/dev/sdc'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665643566366330', 'path': '/dev/sdc'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lazy-loading 'flavor' on Instance uuid ff61d99e-4db9-421f-8c01-264a7278c095 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:47:56 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:47:56 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:47:56 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:47:56 user nova-compute[71325]:   <serial>68f18b86-11cf-4281-8970-f6f9abe4ea96</serial>
Apr 13 21:47:56 user nova-compute[71325]: </disk>
Apr 13 21:47:56 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:47:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] No BDM found with device name hda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:47:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] No VIF found with MAC fa:16:3e:a2:5a:69, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:47:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "ff61d99e-4db9-421f-8c01-264a7278c095" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.594s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "ff61d99e-4db9-421f-8c01-264a7278c095" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "ff61d99e-4db9-421f-8c01-264a7278c095" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:58 user nova-compute[71325]: INFO nova.compute.manager [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Detaching volume 68f18b86-11cf-4281-8970-f6f9abe4ea96
Apr 13 21:47:58 user nova-compute[71325]: INFO nova.virt.block_device [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Attempting to driver detach volume 68f18b86-11cf-4281-8970-f6f9abe4ea96 from mountpoint /dev/vdb
Apr 13 21:47:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Attempting to detach device vdb from instance ff61d99e-4db9-421f-8c01-264a7278c095 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:47:58 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:47:58 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:47:58 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:47:58 user nova-compute[71325]:   <serial>68f18b86-11cf-4281-8970-f6f9abe4ea96</serial>
Apr 13 21:47:58 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 21:47:58 user nova-compute[71325]: </disk>
Apr 13 21:47:58 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:47:58 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Successfully detached device vdb from instance ff61d99e-4db9-421f-8c01-264a7278c095 from the persistent domain config.
Apr 13 21:47:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff61d99e-4db9-421f-8c01-264a7278c095 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:47:58 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:47:58 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:47:58 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:47:58 user nova-compute[71325]:   <serial>68f18b86-11cf-4281-8970-f6f9abe4ea96</serial>
Apr 13 21:47:58 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 21:47:58 user nova-compute[71325]: </disk>
Apr 13 21:47:58 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681422478.7741199, ff61d99e-4db9-421f-8c01-264a7278c095 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff61d99e-4db9-421f-8c01-264a7278c095 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:47:58 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Successfully detached device vdb from instance ff61d99e-4db9-421f-8c01-264a7278c095 from the live domain config.
Apr 13 21:47:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iyNYoFVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:47:58 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:47:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0798f801-e61e-4bb8-8a08-1a16ad71d3de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:47:58 user nova-compute[71325]: No targets found.
Apr 13 21:47:58 user nova-compute[71325]: iSNS:
Apr 13 21:47:58 user nova-compute[71325]: No targets found.
Apr 13 21:47:58 user nova-compute[71325]: STATIC:
Apr 13 21:47:58 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96
Apr 13 21:47:58 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:58 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:58 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27
Apr 13 21:47:58 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:58 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:58 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae
Apr 13 21:47:58 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:47:58 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:47:58 user nova-compute[71325]: FIRMWARE:
Apr 13 21:47:58 user nova-compute[71325]: No targets found.
Apr 13 21:47:58 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:47:58 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:47:58 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d79841-b27f-4890-841e-7119467c8e2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7161994-8c90-4c51-81fc-e21261647b0b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:58 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:47:58 user nova-compute[71325]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 (non-flash)
Apr 13 21:47:58 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:47:58 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:47:58 user nova-compute[71325]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 (non-flash)
Apr 13 21:47:58 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7e8c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96'): ({'sdc'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Removing single pathed devices sdc {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a97586-ef84-4f86-af0f-dee86cd46192]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be43276-7501-4298-bece-368ab85d0627]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Flushing IO for device /dev/sdc {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd8f28e-4e21-45e4-84ac-c69174b782f9]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:47:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42865e3-2e05-4891-ba52-1a13933f575a]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[449d4931-00f2-4320-be48-55c1579919ff]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1be329-6c0c-44d8-a5ad-a993305a84fd]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96, portal: 172.16.0.220,3260]
Apr 13 21:47:59 user nova-compute[71325]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96, portal: 172.16.0.220,3260] successful.
Apr 13 21:47:59 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f18b86-11cf-4281-8970-f6f9abe4ea96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[171f761d-29fe-4a63-ac87-e37152edb601]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] <== disconnect_volume: return (348ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG nova.objects.instance [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lazy-loading 'flavor' on Instance uuid ff61d99e-4db9-421f-8c01-264a7278c095 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:47:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "ff61d99e-4db9-421f-8c01-264a7278c095" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.780s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoQMDOWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '35820c1d-307d-43ed-b3d1-31fe12602870', 'attached_at': '', 'detached_at': '', 'volume_id': '36939113-535a-44e7-a3b9-f81c95e278c4', 'serial': '36939113-535a-44e7-a3b9-f81c95e278c4'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQpZxYWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '232f1088-3899-4c7b-afcb-b2847abf5b27'}, 'status': 'reserved', 'instance': '35820c1d-307d-43ed-b3d1-31fe12602870', 'attached_at': '', 'detached_at': '', 'volume_id': '232f1088-3899-4c7b-afcb-b2847abf5b27', 'serial'} {{(pid=71325) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "interface-ff61d99e-4db9-421f-8c01-264a7278c095-30cd1e3e-0642-43d5-816d-210deb9ace23" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "interface-ff61d99e-4db9-421f-8c01-264a7278c095-30cd1e3e-0642-43d5-816d-210deb9ace23" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoQMDOWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:48:00 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:48:00 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:48:00 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24ab961-6f22-4a54-a0d7-d37aa7001629]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:48:00 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.objects.instance [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lazy-loading 'flavor' on Instance uuid ff61d99e-4db9-421f-8c01-264a7278c095 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbf9568-507c-4290-be3c-b5cadb715971]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4] added
Apr 13 21:48:00 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-155987669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-155987669',id=11,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv5A5QM89WDKnsULhMuooVL+m28bgPV7OihZIzGssK7PgLTiXl/GrJAAaMRdz+PYZbhzGzt+oX5wWpDIz3NkiaY2vLH+14jBnJVm8Ym0U0jNo9V6zKnqyN1OlYdbXBS3Q==',key_name='tempest-keypair-1492294196',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fd0897baf2c455c87ac9a330a673d8e',ramdisk_id='',reservation_id='r-jqdpikg2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1835832502',owner_user_name='tempest-TaggedAttachmentsTest-1835832502-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18587f4671a34f568e00dbee3f33eb8b',uuid=ff61d99e-4db9-421f-8c01-264a7278c095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30cd1e3e-0642-43d5-816d-210deb9ace23", "address": "fa:16:3e:45:57:fe", "network": {"id": "ef33d497-2e44-4569-80c1-86dfb7a13837", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-439692832", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30cd1e3e-06", "ovs_interfaceid": "30cd1e3e-0642-43d5-816d-210deb9ace23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Converting VIF {"id": "30cd1e3e-0642-43d5-816d-210deb9ace23", "address": "fa:16:3e:45:57:fe", "network": {"id": "ef33d497-2e44-4569-80c1-86dfb7a13837", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-439692832", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30cd1e3e-06", "ovs_interfaceid": "30cd1e3e-0642-43d5-816d-210deb9ace23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=30cd1e3e-0642-43d5-816d-210deb9ace23,network=Network(ef33d497-2e44-4569-80c1-86dfb7a13837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30cd1e3e-06') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:45:57:fe"/><model type="virtio"/><mtu size="1442"/><target dev="tap30cd1e3e-06"/></interface> {{(pid=71325) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:45:57:fe"/><model type="virtio"/><mtu size="1442"/><target dev="tap30cd1e3e-06"/></interface> {{(pid=71325) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Attempting to detach device tap30cd1e3e-06 from instance ff61d99e-4db9-421f-8c01-264a7278c095 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] detach device xml: <interface type="ethernet">
Apr 13 21:48:00 user nova-compute[71325]:   <mac address="fa:16:3e:45:57:fe"/>
Apr 13 21:48:00 user nova-compute[71325]:   <model type="virtio"/>
Apr 13 21:48:00 user nova-compute[71325]:   <mtu size="1442"/>
Apr 13 21:48:00 user nova-compute[71325]:   <target dev="tap30cd1e3e-06"/>
Apr 13 21:48:00 user nova-compute[71325]: </interface>
Apr 13 21:48:00 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[550788ff-b3f0-4072-a985-3cd038df6810]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:45:57:fe"/><model type="virtio"/><mtu size="1442"/><target dev="tap30cd1e3e-06"/></interface> {{(pid=71325) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:45:57:fe"/><model type="virtio"/><mtu size="1442"/><target dev="tap30cd1e3e-06"/></interface>not found in domain: <domain type='kvm' id='11'>
Apr 13 21:48:00 user nova-compute[71325]:   <name>instance-0000000b</name>
Apr 13 21:48:00 user nova-compute[71325]:   <uuid>ff61d99e-4db9-421f-8c01-264a7278c095</uuid>
Apr 13 21:48:00 user nova-compute[71325]:   <metadata>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:48:00 user nova-compute[71325]:   <nova:package version="0.0.0"/>
Apr 13 21:48:00 user nova-compute[71325]:   <nova:name>tempest-device-tagging-server-155987669</nova:name>
Apr 13 21:48:00 user nova-compute[71325]:   <nova:creationTime>2023-04-13 21:47:47</nova:creationTime>
Apr 13 21:48:00 user nova-compute[71325]:   <nova:flavor name="m1.nano">
Apr 13 21:48:00 user nova-compute[71325]:     <nova:memory>128</nova:memory>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:disk>1</nova:disk>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:swap>0</nova:swap>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:vcpus>1</nova:vcpus>
Apr 13 21:48:00 user nova-compute[71325]:   </nova:flavor>
Apr 13 21:48:00 user nova-compute[71325]:   <nova:owner>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:user uuid="18587f4671a34f568e00dbee3f33eb8b">tempest-TaggedAttachmentsTest-1835832502-project-member</nova:user>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:project uuid="2fd0897baf2c455c87ac9a330a673d8e">tempest-TaggedAttachmentsTest-1835832502</nova:project>
Apr 13 21:48:00 user nova-compute[71325]:   </nova:owner>
Apr 13 21:48:00 user nova-compute[71325]:   <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:48:00 user nova-compute[71325]:   <nova:ports>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:port uuid="8c222f8e-f61d-4b04-87c4-edd1ca83b22b">
Apr 13 21:48:00 user nova-compute[71325]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 21:48:00 user nova-compute[71325]:     </nova:port>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:port uuid="30cd1e3e-0642-43d5-816d-210deb9ace23">
Apr 13 21:48:00 user nova-compute[71325]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Apr 13 21:48:00 user nova-compute[71325]:     </nova:port>
Apr 13 21:48:00 user nova-compute[71325]:   </nova:ports>
Apr 13 21:48:00 user nova-compute[71325]: </nova:instance>
Apr 13 21:48:00 user nova-compute[71325]:   </metadata>
Apr 13 21:48:00 user nova-compute[71325]:   <memory unit='KiB'>131072</memory>
Apr 13 21:48:00 user nova-compute[71325]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 21:48:00 user nova-compute[71325]:   <vcpu placement='static'>1</vcpu>
Apr 13 21:48:00 user nova-compute[71325]:   <resource>
Apr 13 21:48:00 user nova-compute[71325]:     <partition>/machine</partition>
Apr 13 21:48:00 user nova-compute[71325]:   </resource>
Apr 13 21:48:00 user nova-compute[71325]:   <sysinfo type='smbios'>
Apr 13 21:48:00 user nova-compute[71325]:     <system>
Apr 13 21:48:00 user nova-compute[71325]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 21:48:00 user nova-compute[71325]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 21:48:00 user nova-compute[71325]:       <entry name='version'>0.0.0</entry>
Apr 13 21:48:00 user nova-compute[71325]:       <entry name='serial'>ff61d99e-4db9-421f-8c01-264a7278c095</entry>
Apr 13 21:48:00 user nova-compute[71325]:       <entry name='uuid'>ff61d99e-4db9-421f-8c01-264a7278c095</entry>
Apr 13 21:48:00 user nova-compute[71325]:       <entry name='family'>Virtual Machine</entry>
Apr 13 21:48:00 user nova-compute[71325]:     </system>
Apr 13 21:48:00 user nova-compute[71325]:   </sysinfo>
Apr 13 21:48:00 user nova-compute[71325]:   <os>
Apr 13 21:48:00 user nova-compute[71325]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 21:48:00 user nova-compute[71325]:     <boot dev='hd'/>
Apr 13 21:48:00 user nova-compute[71325]:     <smbios mode='sysinfo'/>
Apr 13 21:48:00 user nova-compute[71325]:   </os>
Apr 13 21:48:00 user nova-compute[71325]:   <features>
Apr 13 21:48:00 user nova-compute[71325]:     <acpi/>
Apr 13 21:48:00 user nova-compute[71325]:     <apic/>
Apr 13 21:48:00 user nova-compute[71325]:     <vmcoreinfo state='on'/>
Apr 13 21:48:00 user nova-compute[71325]:   </features>
Apr 13 21:48:00 user nova-compute[71325]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 21:48:00 user nova-compute[71325]:     <model fallback='forbid'>Nehalem</model>
Apr 13 21:48:00 user nova-compute[71325]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 21:48:00 user nova-compute[71325]:     <feature policy='require' name='vme'/>
Apr 13 21:48:00 user nova-compute[71325]:     <feature policy='require' name='x2apic'/>
Apr 13 21:48:00 user nova-compute[71325]:     <feature policy='require' name='hypervisor'/>
Apr 13 21:48:00 user nova-compute[71325]:   </cpu>
Apr 13 21:48:00 user nova-compute[71325]:   <clock offset='utc'>
Apr 13 21:48:00 user nova-compute[71325]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 21:48:00 user nova-compute[71325]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 21:48:00 user nova-compute[71325]:     <timer name='hpet' present='no'/>
Apr 13 21:48:00 user nova-compute[71325]:   </clock>
Apr 13 21:48:00 user nova-compute[71325]:   <on_poweroff>destroy</on_poweroff>
Apr 13 21:48:00 user nova-compute[71325]:   <on_reboot>restart</on_reboot>
Apr 13 21:48:00 user nova-compute[71325]:   <on_crash>destroy</on_crash>
Apr 13 21:48:00 user nova-compute[71325]:   <devices>
Apr 13 21:48:00 user nova-compute[71325]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 21:48:00 user nova-compute[71325]:     <disk type='file' device='disk'>
Apr 13 21:48:00 user nova-compute[71325]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 21:48:00 user nova-compute[71325]:       <source file='/opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk' index='2'/>
Apr 13 21:48:00 user nova-compute[71325]:       <backingStore type='file' index='3'>
Apr 13 21:48:00 user nova-compute[71325]:         <format type='raw'/>
Apr 13 21:48:00 user nova-compute[71325]:         <source file='/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9'/>
Apr 13 21:48:00 user nova-compute[71325]:         <backingStore/>
Apr 13 21:48:00 user nova-compute[71325]:       </backingStore>
Apr 13 21:48:00 user nova-compute[71325]:       <target dev='vda' bus='virtio'/>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='virtio-disk0'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </disk>
Apr 13 21:48:00 user nova-compute[71325]:     <disk type='file' device='cdrom'>
Apr 13 21:48:00 user nova-compute[71325]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 21:48:00 user nova-compute[71325]:       <source file='/opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk.config' index='1'/>
Apr 13 21:48:00 user nova-compute[71325]:       <backingStore/>
Apr 13 21:48:00 user nova-compute[71325]:       <target dev='hda' bus='ide'/>
Apr 13 21:48:00 user nova-compute[71325]:       <readonly/>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='ide0-0-0'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </disk>
Apr 13 21:48:00 user nova-compute[71325]:     <controller type='usb' index='0' model='none'>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='usb'/>
Apr 13 21:48:00 user nova-compute[71325]:     </controller>
Apr 13 21:48:00 user nova-compute[71325]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='pci.0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </controller>
Apr 13 21:48:00 user nova-compute[71325]:     <controller type='ide' index='0'>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='ide'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 21:48:00 user nova-compute[71325]:     </controller>
Apr 13 21:48:00 user nova-compute[71325]:     <interface type='ethernet'>
Apr 13 21:48:00 user nova-compute[71325]:       <mac address='fa:16:3e:a2:5a:69'/>
Apr 13 21:48:00 user nova-compute[71325]:       <target dev='tap8c222f8e-f6'/>
Apr 13 21:48:00 user nova-compute[71325]:       <model type='virtio'/>
Apr 13 21:48:00 user nova-compute[71325]:       <mtu size='1442'/>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='net0'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </interface>
Apr 13 21:48:00 user nova-compute[71325]:     <interface type='ethernet'>
Apr 13 21:48:00 user nova-compute[71325]:       <mac address='fa:16:3e:45:57:fe'/>
Apr 13 21:48:00 user nova-compute[71325]:       <target dev='tap30cd1e3e-06'/>
Apr 13 21:48:00 user nova-compute[71325]:       <model type='virtio'/>
Apr 13 21:48:00 user nova-compute[71325]:       <mtu size='1442'/>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='net1'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </interface>
Apr 13 21:48:00 user nova-compute[71325]:     <serial type='pty'>
Apr 13 21:48:00 user nova-compute[71325]:       <source path='/dev/pts/10'/>
Apr 13 21:48:00 user nova-compute[71325]:       <log file='/opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/console.log' append='off'/>
Apr 13 21:48:00 user nova-compute[71325]:       <target type='isa-serial' port='0'>
Apr 13 21:48:00 user nova-compute[71325]:         <model name='isa-serial'/>
Apr 13 21:48:00 user nova-compute[71325]:       </target>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='serial0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </serial>
Apr 13 21:48:00 user nova-compute[71325]:     <console type='pty' tty='/dev/pts/10'>
Apr 13 21:48:00 user nova-compute[71325]:       <source path='/dev/pts/10'/>
Apr 13 21:48:00 user nova-compute[71325]:       <log file='/opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/console.log' append='off'/>
Apr 13 21:48:00 user nova-compute[71325]:       <target type='serial' port='0'/>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='serial0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </console>
Apr 13 21:48:00 user nova-compute[71325]:     <input type='mouse' bus='ps2'>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='input0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </input>
Apr 13 21:48:00 user nova-compute[71325]:     <input type='keyboard' bus='ps2'>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='input1'/>
Apr 13 21:48:00 user nova-compute[71325]:     </input>
Apr 13 21:48:00 user nova-compute[71325]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Apr 13 21:48:00 user nova-compute[71325]:       <listen type='address' address='0.0.0.0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </graphics>
Apr 13 21:48:00 user nova-compute[71325]:     <audio id='1' type='none'/>
Apr 13 21:48:00 user nova-compute[71325]:     <video>
Apr 13 21:48:00 user nova-compute[71325]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='video0'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </video>
Apr 13 21:48:00 user nova-compute[71325]:     <memballoon model='virtio'>
Apr 13 21:48:00 user nova-compute[71325]:       <stats period='10'/>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='balloon0'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </memballoon>
Apr 13 21:48:00 user nova-compute[71325]:     <rng model='virtio'>
Apr 13 21:48:00 user nova-compute[71325]:       <backend model='random'>/dev/urandom</backend>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='rng0'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </rng>
Apr 13 21:48:00 user nova-compute[71325]:   </devices>
Apr 13 21:48:00 user nova-compute[71325]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 21:48:00 user nova-compute[71325]:     <label>libvirt-ff61d99e-4db9-421f-8c01-264a7278c095</label>
Apr 13 21:48:00 user nova-compute[71325]:     <imagelabel>libvirt-ff61d99e-4db9-421f-8c01-264a7278c095</imagelabel>
Apr 13 21:48:00 user nova-compute[71325]:   </seclabel>
Apr 13 21:48:00 user nova-compute[71325]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 21:48:00 user nova-compute[71325]:     <label>+64055:+108</label>
Apr 13 21:48:00 user nova-compute[71325]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 21:48:00 user nova-compute[71325]:   </seclabel>
Apr 13 21:48:00 user nova-compute[71325]: </domain>
Apr 13 21:48:00 user nova-compute[71325]:  {{(pid=71325) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 21:48:00 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Successfully detached device tap30cd1e3e-06 from instance ff61d99e-4db9-421f-8c01-264a7278c095 from the persistent domain config.
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] (1/8): Attempting to detach device tap30cd1e3e-06 with device alias net1 from instance ff61d99e-4db9-421f-8c01-264a7278c095 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] detach device xml: <interface type="ethernet">
Apr 13 21:48:00 user nova-compute[71325]:   <mac address="fa:16:3e:45:57:fe"/>
Apr 13 21:48:00 user nova-compute[71325]:   <model type="virtio"/>
Apr 13 21:48:00 user nova-compute[71325]:   <mtu size="1442"/>
Apr 13 21:48:00 user nova-compute[71325]:   <target dev="tap30cd1e3e-06"/>
Apr 13 21:48:00 user nova-compute[71325]: </interface>
Apr 13 21:48:00 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fca2b7-e478-4260-9f55-d7b813b2f2fb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KoQMDOWl {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KoQMDOWl" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3082fb1-4578-4847-8234-23689c860859]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KoQMDOWl'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4872366c-4e82-41fd-9cf8-2b9ca02de92c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f17a31-9326-41b7-b775-7ff93e92e46e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:00 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:48:00 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:00 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:48:00 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17bf1b6-727d-4b46-97c2-0da63c675bbc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260]
Apr 13 21:48:00 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260] successful.
Apr 13 21:48:00 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681422480.9192479, ff61d99e-4db9-421f-8c01-264a7278c095 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd25d3e-2da6-4fab-98a2-3c17a63537af]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Start waiting for the detach event from libvirt for device tap30cd1e3e-06 with device alias net1 for instance ff61d99e-4db9-421f-8c01-264a7278c095 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:45:57:fe"/><model type="virtio"/><mtu size="1442"/><target dev="tap30cd1e3e-06"/></interface> {{(pid=71325) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[337e01bf-3fb8-484b-9863-203add3bb44a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:00 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:48:00 user nova-compute[71325]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:48:00 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:00 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:48:00 user nova-compute[71325]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:48:00 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:45:57:fe"/><model type="virtio"/><mtu size="1442"/><target dev="tap30cd1e3e-06"/></interface>not found in domain: <domain type='kvm' id='11'>
Apr 13 21:48:00 user nova-compute[71325]:   <name>instance-0000000b</name>
Apr 13 21:48:00 user nova-compute[71325]:   <uuid>ff61d99e-4db9-421f-8c01-264a7278c095</uuid>
Apr 13 21:48:00 user nova-compute[71325]:   <metadata>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:48:00 user nova-compute[71325]:   <nova:package version="0.0.0"/>
Apr 13 21:48:00 user nova-compute[71325]:   <nova:name>tempest-device-tagging-server-155987669</nova:name>
Apr 13 21:48:00 user nova-compute[71325]:   <nova:creationTime>2023-04-13 21:47:47</nova:creationTime>
Apr 13 21:48:00 user nova-compute[71325]:   <nova:flavor name="m1.nano">
Apr 13 21:48:00 user nova-compute[71325]:     <nova:memory>128</nova:memory>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:disk>1</nova:disk>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:swap>0</nova:swap>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:vcpus>1</nova:vcpus>
Apr 13 21:48:00 user nova-compute[71325]:   </nova:flavor>
Apr 13 21:48:00 user nova-compute[71325]:   <nova:owner>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:user uuid="18587f4671a34f568e00dbee3f33eb8b">tempest-TaggedAttachmentsTest-1835832502-project-member</nova:user>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:project uuid="2fd0897baf2c455c87ac9a330a673d8e">tempest-TaggedAttachmentsTest-1835832502</nova:project>
Apr 13 21:48:00 user nova-compute[71325]:   </nova:owner>
Apr 13 21:48:00 user nova-compute[71325]:   <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:48:00 user nova-compute[71325]:   <nova:ports>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:port uuid="8c222f8e-f61d-4b04-87c4-edd1ca83b22b">
Apr 13 21:48:00 user nova-compute[71325]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 21:48:00 user nova-compute[71325]:     </nova:port>
Apr 13 21:48:00 user nova-compute[71325]:     <nova:port uuid="30cd1e3e-0642-43d5-816d-210deb9ace23">
Apr 13 21:48:00 user nova-compute[71325]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Apr 13 21:48:00 user nova-compute[71325]:     </nova:port>
Apr 13 21:48:00 user nova-compute[71325]:   </nova:ports>
Apr 13 21:48:00 user nova-compute[71325]: </nova:instance>
Apr 13 21:48:00 user nova-compute[71325]:   </metadata>
Apr 13 21:48:00 user nova-compute[71325]:   <memory unit='KiB'>131072</memory>
Apr 13 21:48:00 user nova-compute[71325]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 21:48:00 user nova-compute[71325]:   <vcpu placement='static'>1</vcpu>
Apr 13 21:48:00 user nova-compute[71325]:   <resource>
Apr 13 21:48:00 user nova-compute[71325]:     <partition>/machine</partition>
Apr 13 21:48:00 user nova-compute[71325]:   </resource>
Apr 13 21:48:00 user nova-compute[71325]:   <sysinfo type='smbios'>
Apr 13 21:48:00 user nova-compute[71325]:     <system>
Apr 13 21:48:00 user nova-compute[71325]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 21:48:00 user nova-compute[71325]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 21:48:00 user nova-compute[71325]:       <entry name='version'>0.0.0</entry>
Apr 13 21:48:00 user nova-compute[71325]:       <entry name='serial'>ff61d99e-4db9-421f-8c01-264a7278c095</entry>
Apr 13 21:48:00 user nova-compute[71325]:       <entry name='uuid'>ff61d99e-4db9-421f-8c01-264a7278c095</entry>
Apr 13 21:48:00 user nova-compute[71325]:       <entry name='family'>Virtual Machine</entry>
Apr 13 21:48:00 user nova-compute[71325]:     </system>
Apr 13 21:48:00 user nova-compute[71325]:   </sysinfo>
Apr 13 21:48:00 user nova-compute[71325]:   <os>
Apr 13 21:48:00 user nova-compute[71325]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 21:48:00 user nova-compute[71325]:     <boot dev='hd'/>
Apr 13 21:48:00 user nova-compute[71325]:     <smbios mode='sysinfo'/>
Apr 13 21:48:00 user nova-compute[71325]:   </os>
Apr 13 21:48:00 user nova-compute[71325]:   <features>
Apr 13 21:48:00 user nova-compute[71325]:     <acpi/>
Apr 13 21:48:00 user nova-compute[71325]:     <apic/>
Apr 13 21:48:00 user nova-compute[71325]:     <vmcoreinfo state='on'/>
Apr 13 21:48:00 user nova-compute[71325]:   </features>
Apr 13 21:48:00 user nova-compute[71325]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 21:48:00 user nova-compute[71325]:     <model fallback='forbid'>Nehalem</model>
Apr 13 21:48:00 user nova-compute[71325]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 21:48:00 user nova-compute[71325]:     <feature policy='require' name='vme'/>
Apr 13 21:48:00 user nova-compute[71325]:     <feature policy='require' name='x2apic'/>
Apr 13 21:48:00 user nova-compute[71325]:     <feature policy='require' name='hypervisor'/>
Apr 13 21:48:00 user nova-compute[71325]:   </cpu>
Apr 13 21:48:00 user nova-compute[71325]:   <clock offset='utc'>
Apr 13 21:48:00 user nova-compute[71325]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 21:48:00 user nova-compute[71325]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 21:48:00 user nova-compute[71325]:     <timer name='hpet' present='no'/>
Apr 13 21:48:00 user nova-compute[71325]:   </clock>
Apr 13 21:48:00 user nova-compute[71325]:   <on_poweroff>destroy</on_poweroff>
Apr 13 21:48:00 user nova-compute[71325]:   <on_reboot>restart</on_reboot>
Apr 13 21:48:00 user nova-compute[71325]:   <on_crash>destroy</on_crash>
Apr 13 21:48:00 user nova-compute[71325]:   <devices>
Apr 13 21:48:00 user nova-compute[71325]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 21:48:00 user nova-compute[71325]:     <disk type='file' device='disk'>
Apr 13 21:48:00 user nova-compute[71325]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 21:48:00 user nova-compute[71325]:       <source file='/opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk' index='2'/>
Apr 13 21:48:00 user nova-compute[71325]:       <backingStore type='file' index='3'>
Apr 13 21:48:00 user nova-compute[71325]:         <format type='raw'/>
Apr 13 21:48:00 user nova-compute[71325]:         <source file='/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9'/>
Apr 13 21:48:00 user nova-compute[71325]:         <backingStore/>
Apr 13 21:48:00 user nova-compute[71325]:       </backingStore>
Apr 13 21:48:00 user nova-compute[71325]:       <target dev='vda' bus='virtio'/>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='virtio-disk0'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </disk>
Apr 13 21:48:00 user nova-compute[71325]:     <disk type='file' device='cdrom'>
Apr 13 21:48:00 user nova-compute[71325]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 21:48:00 user nova-compute[71325]:       <source file='/opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/disk.config' index='1'/>
Apr 13 21:48:00 user nova-compute[71325]:       <backingStore/>
Apr 13 21:48:00 user nova-compute[71325]:       <target dev='hda' bus='ide'/>
Apr 13 21:48:00 user nova-compute[71325]:       <readonly/>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='ide0-0-0'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </disk>
Apr 13 21:48:00 user nova-compute[71325]:     <controller type='usb' index='0' model='none'>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='usb'/>
Apr 13 21:48:00 user nova-compute[71325]:     </controller>
Apr 13 21:48:00 user nova-compute[71325]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='pci.0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </controller>
Apr 13 21:48:00 user nova-compute[71325]:     <controller type='ide' index='0'>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='ide'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 21:48:00 user nova-compute[71325]:     </controller>
Apr 13 21:48:00 user nova-compute[71325]:     <interface type='ethernet'>
Apr 13 21:48:00 user nova-compute[71325]:       <mac address='fa:16:3e:a2:5a:69'/>
Apr 13 21:48:00 user nova-compute[71325]:       <target dev='tap8c222f8e-f6'/>
Apr 13 21:48:00 user nova-compute[71325]:       <model type='virtio'/>
Apr 13 21:48:00 user nova-compute[71325]:       <mtu size='1442'/>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='net0'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </interface>
Apr 13 21:48:00 user nova-compute[71325]:     <serial type='pty'>
Apr 13 21:48:00 user nova-compute[71325]:       <source path='/dev/pts/10'/>
Apr 13 21:48:00 user nova-compute[71325]:       <log file='/opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/console.log' append='off'/>
Apr 13 21:48:00 user nova-compute[71325]:       <target type='isa-serial' port='0'>
Apr 13 21:48:00 user nova-compute[71325]:         <model name='isa-serial'/>
Apr 13 21:48:00 user nova-compute[71325]:       </target>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='serial0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </serial>
Apr 13 21:48:00 user nova-compute[71325]:     <console type='pty' tty='/dev/pts/10'>
Apr 13 21:48:00 user nova-compute[71325]:       <source path='/dev/pts/10'/>
Apr 13 21:48:00 user nova-compute[71325]:       <log file='/opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095/console.log' append='off'/>
Apr 13 21:48:00 user nova-compute[71325]:       <target type='serial' port='0'/>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='serial0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </console>
Apr 13 21:48:00 user nova-compute[71325]:     <input type='mouse' bus='ps2'>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='input0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </input>
Apr 13 21:48:00 user nova-compute[71325]:     <input type='keyboard' bus='ps2'>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='input1'/>
Apr 13 21:48:00 user nova-compute[71325]:     </input>
Apr 13 21:48:00 user nova-compute[71325]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Apr 13 21:48:00 user nova-compute[71325]:       <listen type='address' address='0.0.0.0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </graphics>
Apr 13 21:48:00 user nova-compute[71325]:     <audio id='1' type='none'/>
Apr 13 21:48:00 user nova-compute[71325]:     <video>
Apr 13 21:48:00 user nova-compute[71325]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='video0'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </video>
Apr 13 21:48:00 user nova-compute[71325]:     <memballoon model='virtio'>
Apr 13 21:48:00 user nova-compute[71325]:       <stats period='10'/>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='balloon0'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </memballoon>
Apr 13 21:48:00 user nova-compute[71325]:     <rng model='virtio'>
Apr 13 21:48:00 user nova-compute[71325]:       <backend model='random'>/dev/urandom</backend>
Apr 13 21:48:00 user nova-compute[71325]:       <alias name='rng0'/>
Apr 13 21:48:00 user nova-compute[71325]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 21:48:00 user nova-compute[71325]:     </rng>
Apr 13 21:48:00 user nova-compute[71325]:   </devices>
Apr 13 21:48:00 user nova-compute[71325]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 21:48:00 user nova-compute[71325]:     <label>libvirt-ff61d99e-4db9-421f-8c01-264a7278c095</label>
Apr 13 21:48:00 user nova-compute[71325]:     <imagelabel>libvirt-ff61d99e-4db9-421f-8c01-264a7278c095</imagelabel>
Apr 13 21:48:00 user nova-compute[71325]:   </seclabel>
Apr 13 21:48:00 user nova-compute[71325]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 21:48:00 user nova-compute[71325]:     <label>+64055:+108</label>
Apr 13 21:48:00 user nova-compute[71325]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 21:48:00 user nova-compute[71325]:   </seclabel>
Apr 13 21:48:00 user nova-compute[71325]: </domain>
Apr 13 21:48:00 user nova-compute[71325]:  {{(pid=71325) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 21:48:01 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Successfully detached device tap30cd1e3e-06 from instance ff61d99e-4db9-421f-8c01-264a7278c095 from the live domain config.
Apr 13 21:48:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-155987669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-155987669',id=11,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv5A5QM89WDKnsULhMuooVL+m28bgPV7OihZIzGssK7PgLTiXl/GrJAAaMRdz+PYZbhzGzt+oX5wWpDIz3NkiaY2vLH+14jBnJVm8Ym0U0jNo9V6zKnqyN1OlYdbXBS3Q==',key_name='tempest-keypair-1492294196',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fd0897baf2c455c87ac9a330a673d8e',ramdisk_id='',reservation_id='r-jqdpikg2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1835832502',owner_user_name='tempest-TaggedAttachmentsTest-1835832502-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18587f4671a34f568e00dbee3f33eb8b',uuid=ff61d99e-4db9-421f-8c01-264a7278c095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30cd1e3e-0642-43d5-816d-210deb9ace23", "address": "fa:16:3e:45:57:fe", "network": {"id": "ef33d497-2e44-4569-80c1-86dfb7a13837", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-439692832", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30cd1e3e-06", "ovs_interfaceid": "30cd1e3e-0642-43d5-816d-210deb9ace23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Converting VIF {"id": "30cd1e3e-0642-43d5-816d-210deb9ace23", "address": "fa:16:3e:45:57:fe", "network": {"id": "ef33d497-2e44-4569-80c1-86dfb7a13837", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-439692832", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30cd1e3e-06", "ovs_interfaceid": "30cd1e3e-0642-43d5-816d-210deb9ace23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=30cd1e3e-0642-43d5-816d-210deb9ace23,network=Network(ef33d497-2e44-4569-80c1-86dfb7a13837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30cd1e3e-06') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG os_vif [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=30cd1e3e-0642-43d5-816d-210deb9ace23,network=Network(ef33d497-2e44-4569-80c1-86dfb7a13837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30cd1e3e-06') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30cd1e3e-06, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfc148e-bf1b-4490-b617-0bd9ac7baed4]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoQMDOWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:01 user nova-compute[71325]: INFO os_vif [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=30cd1e3e-0642-43d5-816d-210deb9ace23,network=Network(ef33d497-2e44-4569-80c1-86dfb7a13837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30cd1e3e-06')
Apr 13 21:48:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:48:01 user nova-compute[71325]:   <nova:package version="0.0.0"/>
Apr 13 21:48:01 user nova-compute[71325]:   <nova:name>tempest-device-tagging-server-155987669</nova:name>
Apr 13 21:48:01 user nova-compute[71325]:   <nova:creationTime>2023-04-13 21:48:01</nova:creationTime>
Apr 13 21:48:01 user nova-compute[71325]:   <nova:flavor name="m1.nano">
Apr 13 21:48:01 user nova-compute[71325]:     <nova:memory>128</nova:memory>
Apr 13 21:48:01 user nova-compute[71325]:     <nova:disk>1</nova:disk>
Apr 13 21:48:01 user nova-compute[71325]:     <nova:swap>0</nova:swap>
Apr 13 21:48:01 user nova-compute[71325]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:48:01 user nova-compute[71325]:     <nova:vcpus>1</nova:vcpus>
Apr 13 21:48:01 user nova-compute[71325]:   </nova:flavor>
Apr 13 21:48:01 user nova-compute[71325]:   <nova:owner>
Apr 13 21:48:01 user nova-compute[71325]:     <nova:user uuid="18587f4671a34f568e00dbee3f33eb8b">tempest-TaggedAttachmentsTest-1835832502-project-member</nova:user>
Apr 13 21:48:01 user nova-compute[71325]:     <nova:project uuid="2fd0897baf2c455c87ac9a330a673d8e">tempest-TaggedAttachmentsTest-1835832502</nova:project>
Apr 13 21:48:01 user nova-compute[71325]:   </nova:owner>
Apr 13 21:48:01 user nova-compute[71325]:   <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:48:01 user nova-compute[71325]:   <nova:ports>
Apr 13 21:48:01 user nova-compute[71325]:     <nova:port uuid="8c222f8e-f61d-4b04-87c4-edd1ca83b22b">
Apr 13 21:48:01 user nova-compute[71325]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 21:48:01 user nova-compute[71325]:     </nova:port>
Apr 13 21:48:01 user nova-compute[71325]:   </nova:ports>
Apr 13 21:48:01 user nova-compute[71325]: </nova:instance>
Apr 13 21:48:01 user nova-compute[71325]:  {{(pid=71325) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG nova.compute.manager [req-a4bb7acc-4b12-48ff-8d63-45559fbaa8dd req-f8486f7c-42a1-4891-bc92-ca5ab88148f3 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received event network-vif-unplugged-30cd1e3e-0642-43d5-816d-210deb9ace23 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a4bb7acc-4b12-48ff-8d63-45559fbaa8dd req-f8486f7c-42a1-4891-bc92-ca5ab88148f3 service nova] Acquiring lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a4bb7acc-4b12-48ff-8d63-45559fbaa8dd req-f8486f7c-42a1-4891-bc92-ca5ab88148f3 service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a4bb7acc-4b12-48ff-8d63-45559fbaa8dd req-f8486f7c-42a1-4891-bc92-ca5ab88148f3 service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG nova.compute.manager [req-a4bb7acc-4b12-48ff-8d63-45559fbaa8dd req-f8486f7c-42a1-4891-bc92-ca5ab88148f3 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] No waiting events found dispatching network-vif-unplugged-30cd1e3e-0642-43d5-816d-210deb9ace23 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:48:01 user nova-compute[71325]: WARNING nova.compute.manager [req-a4bb7acc-4b12-48ff-8d63-45559fbaa8dd req-f8486f7c-42a1-4891-bc92-ca5ab88148f3 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received unexpected event network-vif-unplugged-30cd1e3e-0642-43d5-816d-210deb9ace23 for instance with vm_state active and task_state None.
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquired lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG nova.network.neutron [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:48:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:48:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '26234386532343530', 'path': '/dev/sdc'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:48:02 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234386532343530', 'path': '/dev/sdc'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:48:02 user nova-compute[71325]: DEBUG nova.objects.instance [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lazy-loading 'flavor' on Instance uuid 35820c1d-307d-43ed-b3d1-31fe12602870 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:02 user nova-compute[71325]: INFO nova.network.neutron [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Port 30cd1e3e-0642-43d5-816d-210deb9ace23 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 13 21:48:02 user nova-compute[71325]: DEBUG nova.network.neutron [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Updating instance_info_cache with network_info: [{"id": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "address": "fa:16:3e:a2:5a:69", "network": {"id": "887fc8b4-07a7-4f28-8a55-c09dc080941e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-632369901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c222f8e-f6", "ovs_interfaceid": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:48:02 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 55574528 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:48:02 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:48:02 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:48:02 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7694MB free_disk=26.362892150878906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:48:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Releasing lock "refresh_cache-ff61d99e-4db9-421f-8c01-264a7278c095" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:48:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "interface-ff61d99e-4db9-421f-8c01-264a7278c095-30cd1e3e-0642-43d5-816d-210deb9ace23" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.349s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 35820c1d-307d-43ed-b3d1-31fe12602870 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance be81f393-654b-4b50-856e-00818f3ae59e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ff61d99e-4db9-421f-8c01-264a7278c095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance fe05a421-ee64-492b-a338-0e864458908c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.manager [req-7a7e0d91-e184-4e23-961d-d7fcee316127 req-e50ffba0-4d6b-48bf-9dc5-a3199df87351 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received event network-vif-plugged-30cd1e3e-0642-43d5-816d-210deb9ace23 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7a7e0d91-e184-4e23-961d-d7fcee316127 req-e50ffba0-4d6b-48bf-9dc5-a3199df87351 service nova] Acquiring lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7a7e0d91-e184-4e23-961d-d7fcee316127 req-e50ffba0-4d6b-48bf-9dc5-a3199df87351 service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7a7e0d91-e184-4e23-961d-d7fcee316127 req-e50ffba0-4d6b-48bf-9dc5-a3199df87351 service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.manager [req-7a7e0d91-e184-4e23-961d-d7fcee316127 req-e50ffba0-4d6b-48bf-9dc5-a3199df87351 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] No waiting events found dispatching network-vif-plugged-30cd1e3e-0642-43d5-816d-210deb9ace23 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:48:03 user nova-compute[71325]: WARNING nova.compute.manager [req-7a7e0d91-e184-4e23-961d-d7fcee316127 req-e50ffba0-4d6b-48bf-9dc5-a3199df87351 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received unexpected event network-vif-plugged-30cd1e3e-0642-43d5-816d-210deb9ace23 for instance with vm_state active and task_state None.
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.manager [req-7a7e0d91-e184-4e23-961d-d7fcee316127 req-e50ffba0-4d6b-48bf-9dc5-a3199df87351 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received event network-vif-deleted-30cd1e3e-0642-43d5-816d-210deb9ace23 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 214958080 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.656s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 394264576 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:48:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 569376768 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:48:04 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:48:04 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:48:04 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:48:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:48:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:48:04 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:48:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 734003200 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:48:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Updating instance_info_cache with network_info: [{"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:48:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:48:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:48:05 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:48:05 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:48:05 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:48:05 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:48:05 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:48:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:48:05 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 894435328 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:48:05 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 1071644672 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQpZxYWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '232f1088-3899-4c7b-afcb-b2847abf5b27': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:48:06 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd665574-eade-484c-8482-2b37c574ed6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:48:06 user nova-compute[71325]: No targets found.
Apr 13 21:48:06 user nova-compute[71325]: iSNS:
Apr 13 21:48:06 user nova-compute[71325]: No targets found.
Apr 13 21:48:06 user nova-compute[71325]: STATIC:
Apr 13 21:48:06 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27
Apr 13 21:48:06 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:48:06 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:48:06 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae
Apr 13 21:48:06 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:48:06 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:48:06 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4
Apr 13 21:48:06 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:48:06 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:48:06 user nova-compute[71325]: FIRMWARE:
Apr 13 21:48:06 user nova-compute[71325]: No targets found.
Apr 13 21:48:06 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:48:06 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:48:06 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ec10c9-3af4-46a2-b455-df64df85f4f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbeca32-6fcb-41bf-b34f-a2e94581f20b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:06 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:48:06 user nova-compute[71325]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:48:06 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:06 user nova-compute[71325]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 (non-flash)
Apr 13 21:48:06 user nova-compute[71325]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:48:06 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7d53490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27'): ({'sdf'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Removing single pathed devices sdf {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29303bf-9427-48ec-ad7d-3b4646e0c73b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfd5237-32da-410a-9476-0cec77cf5749]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Flushing IO for device /dev/sdf {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58859c3-4408-4dce-a685-35f4b18a9459]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c0cddc-866e-4c07-bce6-a25e92b1454c]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] SCSI volumes sdf have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7841f3f-904f-48a3-9e27-23f08ca2a6a0]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fa30ac-683b-47f4-b20c-1a635d69dcbd]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27, portal: 172.16.0.220,3260]
Apr 13 21:48:06 user nova-compute[71325]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27, portal: 172.16.0.220,3260] successful.
Apr 13 21:48:06 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:232f1088-3899-4c7b-afcb-b2847abf5b27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[39713493-eabe-4437-aa48-973bcaa96918]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] <== disconnect_volume: return (302ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoQMDOWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '35820c1d-307d-43ed-b3d1-31fe12602870', 'attached_at': '', 'detached_at': '', 'volume_id': '36939113-535a-44e7-a3b9-f81c95e278c4', 'serial'} {{(pid=71325) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 13 21:48:06 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] swap_volume: removing Cinder connection for volume 232f1088-3899-4c7b-afcb-b2847abf5b27 {{(pid=71325) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 13 21:48:07 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422472.3654747, c71cb46d-2737-4b94-8159-267ea4a0a296 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:48:07 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] VM Stopped (Lifecycle Event)
Apr 13 21:48:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-12ddb0e1-62ef-4a08-99d0-f38cd2795688 None None] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:48:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] swap_volume: Updating volume 232f1088-3899-4c7b-afcb-b2847abf5b27 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "KoQMDOWl", "auth_password": "6V5ZGlKLqW3E8t", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "36939113-535a-44e7-a3b9-f81c95e278c4"}, "status": "reserved", "instance": "35820c1d-307d-43ed-b3d1-31fe12602870", "attached_at": "", "detached_at": "", "volume_id": "36939113-535a-44e7-a3b9-f81c95e278c4", "serial": "36939113-535a-44e7-a3b9-f81c95e278c4"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '36939113-535a-44e7-a3b9-f81c95e278c4', 'no_device': None, 'attachment_id': '4c170df0-9f70-4a45-97b0-af7b7a507d0b'} {{(pid=71325) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 13 21:48:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "35820c1d-307d-43ed-b3d1-31fe12602870" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.782s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "35820c1d-307d-43ed-b3d1-31fe12602870" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "35820c1d-307d-43ed-b3d1-31fe12602870" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:09 user nova-compute[71325]: INFO nova.compute.manager [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Detaching volume 36939113-535a-44e7-a3b9-f81c95e278c4
Apr 13 21:48:09 user nova-compute[71325]: INFO nova.virt.block_device [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Attempting to driver detach volume 36939113-535a-44e7-a3b9-f81c95e278c4 from mountpoint /dev/vdb
Apr 13 21:48:09 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Attempting to detach device vdb from instance 35820c1d-307d-43ed-b3d1-31fe12602870 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:48:09 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:48:09 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:48:09 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:48:09 user nova-compute[71325]:   <serial>36939113-535a-44e7-a3b9-f81c95e278c4</serial>
Apr 13 21:48:09 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:48:09 user nova-compute[71325]: </disk>
Apr 13 21:48:09 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:48:09 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Successfully detached device vdb from instance 35820c1d-307d-43ed-b3d1-31fe12602870 from the persistent domain config.
Apr 13 21:48:09 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35820c1d-307d-43ed-b3d1-31fe12602870 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:48:09 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:48:09 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:48:09 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:48:09 user nova-compute[71325]:   <serial>36939113-535a-44e7-a3b9-f81c95e278c4</serial>
Apr 13 21:48:09 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:48:09 user nova-compute[71325]: </disk>
Apr 13 21:48:09 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681422489.6827674, 35820c1d-307d-43ed-b3d1-31fe12602870 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35820c1d-307d-43ed-b3d1-31fe12602870 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:48:09 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Successfully detached device vdb from instance 35820c1d-307d-43ed-b3d1-31fe12602870 from the live domain config.
Apr 13 21:48:09 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoQMDOWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '36939113-535a-44e7-a3b9-f81c95e278c4': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:48:09 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8baae8-463d-4eb5-ab27-0dba022654e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:48:09 user nova-compute[71325]: No targets found.
Apr 13 21:48:09 user nova-compute[71325]: iSNS:
Apr 13 21:48:09 user nova-compute[71325]: No targets found.
Apr 13 21:48:09 user nova-compute[71325]: STATIC:
Apr 13 21:48:09 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae
Apr 13 21:48:09 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:48:09 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:48:09 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4
Apr 13 21:48:09 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:48:09 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:48:09 user nova-compute[71325]: FIRMWARE:
Apr 13 21:48:09 user nova-compute[71325]: No targets found.
Apr 13 21:48:09 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:48:09 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:48:09 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fea49b-53b6-43dc-a21d-0de837694e69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e15e33d-36f6-4beb-afb1-98adb7117a8b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:09 user nova-compute[71325]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:48:09 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:09 user nova-compute[71325]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 (non-flash)
Apr 13 21:48:09 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7dcc790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4'): ({'sdc'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Removing single pathed devices sdc {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc079ae-7693-4c51-bea2-588ef9709b9b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[594eadad-e6bb-4a6b-940c-6759dcf311cd]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Flushing IO for device /dev/sdc {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7e8b9b-093f-4332-b8a6-f33f85e47df1]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d158bd-94e8-4bda-b485-2ebe80e25a92]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db32a8f-ec11-497a-a087-de63326ef7ed]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b69885-154d-4dac-b0e4-85f5a66c9ae3]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260]
Apr 13 21:48:09 user nova-compute[71325]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4, portal: 172.16.0.220,3260] successful.
Apr 13 21:48:09 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36939113-535a-44e7-a3b9-f81c95e278c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[785a31f3-5188-4860-9c55-8fe2bda97225]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] <== disconnect_volume: return (290ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:48:09 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:48:10 user nova-compute[71325]: DEBUG nova.objects.instance [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lazy-loading 'flavor' on Instance uuid 35820c1d-307d-43ed-b3d1-31fe12602870 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "35820c1d-307d-43ed-b3d1-31fe12602870" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.678s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:48:26 user nova-compute[71325]: INFO nova.compute.claims [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Claim successful on node user
Apr 13 21:48:26 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:48:26 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:48:26 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG nova.policy [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:48:26 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Creating image(s)
Apr 13 21:48:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "/opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "/opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "/opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk 1073741824" returned: 0 in 0.053s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Successfully created port: 03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Cannot resize image /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'migration_context' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Ensure instance console log exists: /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Successfully updated port: 03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquired lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.compute.manager [req-efebc61e-817b-4556-90d5-2824a0eb7e56 req-29d1f248-d9be-4135-b8bc-b252abd03b0f service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-changed-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.compute.manager [req-efebc61e-817b-4556-90d5-2824a0eb7e56 req-29d1f248-d9be-4135-b8bc-b252abd03b0f service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Refreshing instance network info cache due to event network-changed-03480082-c22f-4ad9-bc15-d536f115ec88. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-efebc61e-817b-4556-90d5-2824a0eb7e56 req-29d1f248-d9be-4135-b8bc-b252abd03b0f service nova] Acquiring lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating instance_info_cache with network_info: [{"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Releasing lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance network_info: |[{"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-efebc61e-817b-4556-90d5-2824a0eb7e56 req-29d1f248-d9be-4135-b8bc-b252abd03b0f service nova] Acquired lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.network.neutron [req-efebc61e-817b-4556-90d5-2824a0eb7e56 req-29d1f248-d9be-4135-b8bc-b252abd03b0f service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Refreshing network info cache for port 03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Start _get_guest_xml network_info=[{"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:48:28 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:48:28 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-968149372',display_name='tempest-ServerActionsTestJSON-server-968149372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-968149372',id=14,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-p35kb61w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:48:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=c895d9cf-e6c1-42d6-88e3-1209b203fbe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'pci_devices' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:48:28 user nova-compute[71325]:   <uuid>c895d9cf-e6c1-42d6-88e3-1209b203fbe3</uuid>
Apr 13 21:48:28 user nova-compute[71325]:   <name>instance-0000000e</name>
Apr 13 21:48:28 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:48:28 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:48:28 user nova-compute[71325]:   <metadata>
Apr 13 21:48:28 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:48:28 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:48:28 user nova-compute[71325]:       <nova:name>tempest-ServerActionsTestJSON-server-968149372</nova:name>
Apr 13 21:48:28 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:48:28</nova:creationTime>
Apr 13 21:48:28 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:48:28 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:48:28 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:48:28 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:48:28 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:48:28 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:48:28 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:48:28 user nova-compute[71325]:       <nova:owner>
Apr 13 21:48:28 user nova-compute[71325]:         <nova:user uuid="b3db8b01a05b43f68bfd8695253514db">tempest-ServerActionsTestJSON-236976022-project-member</nova:user>
Apr 13 21:48:28 user nova-compute[71325]:         <nova:project uuid="7c086cffbafb4da68f172ab27da232d3">tempest-ServerActionsTestJSON-236976022</nova:project>
Apr 13 21:48:28 user nova-compute[71325]:       </nova:owner>
Apr 13 21:48:28 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:48:28 user nova-compute[71325]:       <nova:ports>
Apr 13 21:48:28 user nova-compute[71325]:         <nova:port uuid="03480082-c22f-4ad9-bc15-d536f115ec88">
Apr 13 21:48:28 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 21:48:28 user nova-compute[71325]:         </nova:port>
Apr 13 21:48:28 user nova-compute[71325]:       </nova:ports>
Apr 13 21:48:28 user nova-compute[71325]:     </nova:instance>
Apr 13 21:48:28 user nova-compute[71325]:   </metadata>
Apr 13 21:48:28 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:48:28 user nova-compute[71325]:     <system>
Apr 13 21:48:28 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:48:28 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:48:28 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:48:28 user nova-compute[71325]:       <entry name="serial">c895d9cf-e6c1-42d6-88e3-1209b203fbe3</entry>
Apr 13 21:48:28 user nova-compute[71325]:       <entry name="uuid">c895d9cf-e6c1-42d6-88e3-1209b203fbe3</entry>
Apr 13 21:48:28 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:48:28 user nova-compute[71325]:     </system>
Apr 13 21:48:28 user nova-compute[71325]:   </sysinfo>
Apr 13 21:48:28 user nova-compute[71325]:   <os>
Apr 13 21:48:28 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:48:28 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:48:28 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:48:28 user nova-compute[71325]:   </os>
Apr 13 21:48:28 user nova-compute[71325]:   <features>
Apr 13 21:48:28 user nova-compute[71325]:     <acpi/>
Apr 13 21:48:28 user nova-compute[71325]:     <apic/>
Apr 13 21:48:28 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:48:28 user nova-compute[71325]:   </features>
Apr 13 21:48:28 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:48:28 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:48:28 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:48:28 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:48:28 user nova-compute[71325]:   </clock>
Apr 13 21:48:28 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:48:28 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:48:28 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:48:28 user nova-compute[71325]:   </cpu>
Apr 13 21:48:28 user nova-compute[71325]:   <devices>
Apr 13 21:48:28 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:48:28 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:48:28 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk"/>
Apr 13 21:48:28 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:48:28 user nova-compute[71325]:     </disk>
Apr 13 21:48:28 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:48:28 user nova-compute[71325]:       <mac address="fa:16:3e:ef:31:9d"/>
Apr 13 21:48:28 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:48:28 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:48:28 user nova-compute[71325]:       <target dev="tap03480082-c2"/>
Apr 13 21:48:28 user nova-compute[71325]:     </interface>
Apr 13 21:48:28 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:48:28 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/console.log" append="off"/>
Apr 13 21:48:28 user nova-compute[71325]:     </serial>
Apr 13 21:48:28 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:48:28 user nova-compute[71325]:     <video>
Apr 13 21:48:28 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:48:28 user nova-compute[71325]:     </video>
Apr 13 21:48:28 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:48:28 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:48:28 user nova-compute[71325]:     </rng>
Apr 13 21:48:28 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:48:28 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:48:28 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:48:28 user nova-compute[71325]:     </memballoon>
Apr 13 21:48:28 user nova-compute[71325]:   </devices>
Apr 13 21:48:28 user nova-compute[71325]: </domain>
Apr 13 21:48:28 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-968149372',display_name='tempest-ServerActionsTestJSON-server-968149372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-968149372',id=14,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-p35kb61w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:48:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=c895d9cf-e6c1-42d6-88e3-1209b203fbe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG os_vif [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03480082-c2, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03480082-c2, col_values=(('external_ids', {'iface-id': '03480082-c22f-4ad9-bc15-d536f115ec88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:31:9d', 'vm-uuid': 'c895d9cf-e6c1-42d6-88e3-1209b203fbe3'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:28 user nova-compute[71325]: INFO os_vif [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2')
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No VIF found with MAC fa:16:3e:ef:31:9d, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.network.neutron [req-efebc61e-817b-4556-90d5-2824a0eb7e56 req-29d1f248-d9be-4135-b8bc-b252abd03b0f service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updated VIF entry in instance network info cache for port 03480082-c22f-4ad9-bc15-d536f115ec88. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG nova.network.neutron [req-efebc61e-817b-4556-90d5-2824a0eb7e56 req-29d1f248-d9be-4135-b8bc-b252abd03b0f service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating instance_info_cache with network_info: [{"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:48:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-efebc61e-817b-4556-90d5-2824a0eb7e56 req-29d1f248-d9be-4135-b8bc-b252abd03b0f service nova] Releasing lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:48:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG nova.compute.manager [req-29a413e0-9d86-474a-b67d-a4a28ad78c3c req-d9ceb060-472e-4da1-8ebb-a9b7b72746ca service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-29a413e0-9d86-474a-b67d-a4a28ad78c3c req-d9ceb060-472e-4da1-8ebb-a9b7b72746ca service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-29a413e0-9d86-474a-b67d-a4a28ad78c3c req-d9ceb060-472e-4da1-8ebb-a9b7b72746ca service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-29a413e0-9d86-474a-b67d-a4a28ad78c3c req-d9ceb060-472e-4da1-8ebb-a9b7b72746ca service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG nova.compute.manager [req-29a413e0-9d86-474a-b67d-a4a28ad78c3c req-d9ceb060-472e-4da1-8ebb-a9b7b72746ca service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:48:30 user nova-compute[71325]: WARNING nova.compute.manager [req-29a413e0-9d86-474a-b67d-a4a28ad78c3c req-d9ceb060-472e-4da1-8ebb-a9b7b72746ca service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state building and task_state spawning.
Apr 13 21:48:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "fe05a421-ee64-492b-a338-0e864458908c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'flavor' on Instance uuid fe05a421-ee64-492b-a338-0e864458908c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "fe05a421-ee64-492b-a338-0e864458908c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "fe05a421-ee64-492b-a338-0e864458908c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:30 user nova-compute[71325]: INFO nova.compute.manager [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Attaching volume 58713f9a-6c26-4fe7-a2bc-967c96ddcc4c to /dev/vdb
Apr 13 21:48:30 user nova-compute[71325]: DEBUG os_brick.utils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[363bb4ab-9ecf-46cc-9118-673e912c2314]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfb37df-4f31-4451-be62-285c06651b69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd05fbc-e232-40f0-92df-6b06edd1eb53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc64aa7f-86e7-4248-9e17-05059c79836b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:48:31 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:48:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e506799-4efa-4d93-b159-7b966f527d7a]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG os_brick.utils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:48:31 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updating existing volume attachment record: a70cb2d6-506b-4b9d-a1b7-5ce4215e40b3 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422512.011365, c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:48:32 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] VM Resumed (Lifecycle Event)
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:48:32 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance spawned successfully.
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:48:32 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422512.0217931, c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:48:32 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] VM Started (Lifecycle Event)
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:48:32 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:48:32 user nova-compute[71325]: INFO nova.compute.manager [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Took 5.42 seconds to spawn the instance on the hypervisor.
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-67592dff-ed2c-45b4-b5c7-b9790fe1da97 req-2d333856-d7df-485c-bddc-59213e532a45 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-67592dff-ed2c-45b4-b5c7-b9790fe1da97 req-2d333856-d7df-485c-bddc-59213e532a45 service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-67592dff-ed2c-45b4-b5c7-b9790fe1da97 req-2d333856-d7df-485c-bddc-59213e532a45 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-67592dff-ed2c-45b4-b5c7-b9790fe1da97 req-2d333856-d7df-485c-bddc-59213e532a45 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-67592dff-ed2c-45b4-b5c7-b9790fe1da97 req-2d333856-d7df-485c-bddc-59213e532a45 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:48:32 user nova-compute[71325]: WARNING nova.compute.manager [req-67592dff-ed2c-45b4-b5c7-b9790fe1da97 req-2d333856-d7df-485c-bddc-59213e532a45 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state building and task_state spawning.
Apr 13 21:48:32 user nova-compute[71325]: INFO nova.compute.manager [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Took 6.32 seconds to build instance.
Apr 13 21:48:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.437s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:48:35 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUdWXroA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:48:35 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:48:35 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:48:35 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:48:35 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:48:35 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:48:36 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff63511-e7ca-4788-8be5-84b48bccfea4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:48:36 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[78772291-e95a-46a1-be33-6f832cef7514]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c] added
Apr 13 21:48:36 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb08d06-4390-4ff0-8667-f60781258b8a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b18c9e5-8276-4777-8024-31295bd05adb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FUdWXroA {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FUdWXroA" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[52490198-41d7-4ae3-b4b1-d8deb0bff623]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FUdWXroA'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "a631dfd9-935a-444d-9b8e-082345fd4413" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "a631dfd9-935a-444d-9b8e-082345fd4413" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc67f14-7c68-43c6-82ed-910168f740ed]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[439495b5-f757-48f5-b6ba-ece6607ef54e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:36 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:36 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5869f778-b36f-4cbf-acd1-5d2ec8b9211e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260]
Apr 13 21:48:36 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260] successful.
Apr 13 21:48:36 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:48:36 user nova-compute[71325]: INFO nova.compute.claims [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Claim successful on node user
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7224cf43-9e6b-4b83-95a8-dd8c98b65641]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[827d15b1-b08d-477d-bf88-4c0674a8a0a2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:48:36 user nova-compute[71325]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:36 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:48:36 user nova-compute[71325]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:36 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[942d2a1f-3c01-42cb-af51-5805fe6787f6]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUdWXroA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:48:36 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:48:36 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG nova.policy [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97e87956414a49c4b3c34e51fe6ed2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a67a9a0d514f19b6cc0b39477a1b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:48:36 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Creating image(s)
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "/opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "/opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "/opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.132s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk 1073741824" returned: 0 in 0.054s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26139663931346235', 'path': '/dev/sdc'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139663931346235', 'path': '/dev/sdc'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'flavor' on Instance uuid fe05a421-ee64-492b-a338-0e864458908c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:48:37 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:48:37 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:48:37 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:48:37 user nova-compute[71325]:   <serial>58713f9a-6c26-4fe7-a2bc-967c96ddcc4c</serial>
Apr 13 21:48:37 user nova-compute[71325]: </disk>
Apr 13 21:48:37 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Successfully created port: 75e0cbd0-5c75-400a-94e3-4cf30eea2093 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.167s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Cannot resize image /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lazy-loading 'migration_context' on Instance uuid a631dfd9-935a-444d-9b8e-082345fd4413 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Ensure instance console log exists: /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] No VIF found with MAC fa:16:3e:cf:dc:b4, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:48:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "fe05a421-ee64-492b-a338-0e864458908c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.029s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Successfully updated port: 75e0cbd0-5c75-400a-94e3-4cf30eea2093 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "refresh_cache-a631dfd9-935a-444d-9b8e-082345fd4413" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquired lock "refresh_cache-a631dfd9-935a-444d-9b8e-082345fd4413" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-5a1aecf0-cbe8-40c5-82de-9de21ddb5806 req-f1dac193-7cae-4982-8959-f84c38615a03 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Received event network-changed-75e0cbd0-5c75-400a-94e3-4cf30eea2093 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-5a1aecf0-cbe8-40c5-82de-9de21ddb5806 req-f1dac193-7cae-4982-8959-f84c38615a03 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Refreshing instance network info cache due to event network-changed-75e0cbd0-5c75-400a-94e3-4cf30eea2093. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5a1aecf0-cbe8-40c5-82de-9de21ddb5806 req-f1dac193-7cae-4982-8959-f84c38615a03 service nova] Acquiring lock "refresh_cache-a631dfd9-935a-444d-9b8e-082345fd4413" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Updating instance_info_cache with network_info: [{"id": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "address": "fa:16:3e:3d:fb:22", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e0cbd0-5c", "ovs_interfaceid": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Releasing lock "refresh_cache-a631dfd9-935a-444d-9b8e-082345fd4413" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Instance network_info: |[{"id": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "address": "fa:16:3e:3d:fb:22", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e0cbd0-5c", "ovs_interfaceid": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5a1aecf0-cbe8-40c5-82de-9de21ddb5806 req-f1dac193-7cae-4982-8959-f84c38615a03 service nova] Acquired lock "refresh_cache-a631dfd9-935a-444d-9b8e-082345fd4413" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.network.neutron [req-5a1aecf0-cbe8-40c5-82de-9de21ddb5806 req-f1dac193-7cae-4982-8959-f84c38615a03 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Refreshing network info cache for port 75e0cbd0-5c75-400a-94e3-4cf30eea2093 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Start _get_guest_xml network_info=[{"id": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "address": "fa:16:3e:3d:fb:22", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e0cbd0-5c", "ovs_interfaceid": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:48:38 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:48:38 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:48:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1692528565',display_name='tempest-VolumesAdminNegativeTest-server-1692528565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1692528565',id=15,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03a67a9a0d514f19b6cc0b39477a1b42',ramdisk_id='',reservation_id='r-dxv4f7m4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1461294072',owner_user_name='tempest-VolumesAdminNegativeTest-1461294072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:48:37Z,user_data=None,user_id='97e87956414a49c4b3c34e51fe6ed2ec',uuid=a631dfd9-935a-444d-9b8e-082345fd4413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "address": "fa:16:3e:3d:fb:22", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e0cbd0-5c", "ovs_interfaceid": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Converting VIF {"id": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "address": "fa:16:3e:3d:fb:22", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e0cbd0-5c", "ovs_interfaceid": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=75e0cbd0-5c75-400a-94e3-4cf30eea2093,network=Network(25a51e04-88d5-45b8-865b-f2c7da7460b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e0cbd0-5c') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lazy-loading 'pci_devices' on Instance uuid a631dfd9-935a-444d-9b8e-082345fd4413 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:48:38 user nova-compute[71325]:   <uuid>a631dfd9-935a-444d-9b8e-082345fd4413</uuid>
Apr 13 21:48:38 user nova-compute[71325]:   <name>instance-0000000f</name>
Apr 13 21:48:38 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:48:38 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:48:38 user nova-compute[71325]:   <metadata>
Apr 13 21:48:38 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:48:38 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:48:38 user nova-compute[71325]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1692528565</nova:name>
Apr 13 21:48:38 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:48:38</nova:creationTime>
Apr 13 21:48:38 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:48:38 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:48:38 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:48:38 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:48:38 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:48:38 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:48:38 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:48:38 user nova-compute[71325]:       <nova:owner>
Apr 13 21:48:38 user nova-compute[71325]:         <nova:user uuid="97e87956414a49c4b3c34e51fe6ed2ec">tempest-VolumesAdminNegativeTest-1461294072-project-member</nova:user>
Apr 13 21:48:38 user nova-compute[71325]:         <nova:project uuid="03a67a9a0d514f19b6cc0b39477a1b42">tempest-VolumesAdminNegativeTest-1461294072</nova:project>
Apr 13 21:48:38 user nova-compute[71325]:       </nova:owner>
Apr 13 21:48:38 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:48:38 user nova-compute[71325]:       <nova:ports>
Apr 13 21:48:38 user nova-compute[71325]:         <nova:port uuid="75e0cbd0-5c75-400a-94e3-4cf30eea2093">
Apr 13 21:48:38 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 21:48:38 user nova-compute[71325]:         </nova:port>
Apr 13 21:48:38 user nova-compute[71325]:       </nova:ports>
Apr 13 21:48:38 user nova-compute[71325]:     </nova:instance>
Apr 13 21:48:38 user nova-compute[71325]:   </metadata>
Apr 13 21:48:38 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:48:38 user nova-compute[71325]:     <system>
Apr 13 21:48:38 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:48:38 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:48:38 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:48:38 user nova-compute[71325]:       <entry name="serial">a631dfd9-935a-444d-9b8e-082345fd4413</entry>
Apr 13 21:48:38 user nova-compute[71325]:       <entry name="uuid">a631dfd9-935a-444d-9b8e-082345fd4413</entry>
Apr 13 21:48:38 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:48:38 user nova-compute[71325]:     </system>
Apr 13 21:48:38 user nova-compute[71325]:   </sysinfo>
Apr 13 21:48:38 user nova-compute[71325]:   <os>
Apr 13 21:48:38 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:48:38 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:48:38 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:48:38 user nova-compute[71325]:   </os>
Apr 13 21:48:38 user nova-compute[71325]:   <features>
Apr 13 21:48:38 user nova-compute[71325]:     <acpi/>
Apr 13 21:48:38 user nova-compute[71325]:     <apic/>
Apr 13 21:48:38 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:48:38 user nova-compute[71325]:   </features>
Apr 13 21:48:38 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:48:38 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:48:38 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:48:38 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:48:38 user nova-compute[71325]:   </clock>
Apr 13 21:48:38 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:48:38 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:48:38 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:48:38 user nova-compute[71325]:   </cpu>
Apr 13 21:48:38 user nova-compute[71325]:   <devices>
Apr 13 21:48:38 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:48:38 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:48:38 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk"/>
Apr 13 21:48:38 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:48:38 user nova-compute[71325]:     </disk>
Apr 13 21:48:38 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:48:38 user nova-compute[71325]:       <mac address="fa:16:3e:3d:fb:22"/>
Apr 13 21:48:38 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:48:38 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:48:38 user nova-compute[71325]:       <target dev="tap75e0cbd0-5c"/>
Apr 13 21:48:38 user nova-compute[71325]:     </interface>
Apr 13 21:48:38 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:48:38 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/console.log" append="off"/>
Apr 13 21:48:38 user nova-compute[71325]:     </serial>
Apr 13 21:48:38 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:48:38 user nova-compute[71325]:     <video>
Apr 13 21:48:38 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:48:38 user nova-compute[71325]:     </video>
Apr 13 21:48:38 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:48:38 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:48:38 user nova-compute[71325]:     </rng>
Apr 13 21:48:38 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:48:38 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:48:38 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:48:38 user nova-compute[71325]:     </memballoon>
Apr 13 21:48:38 user nova-compute[71325]:   </devices>
Apr 13 21:48:38 user nova-compute[71325]: </domain>
Apr 13 21:48:38 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:48:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1692528565',display_name='tempest-VolumesAdminNegativeTest-server-1692528565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1692528565',id=15,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03a67a9a0d514f19b6cc0b39477a1b42',ramdisk_id='',reservation_id='r-dxv4f7m4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1461294072',owner_user_name='tempest-VolumesAdminNegativeTest-1461294072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:48:37Z,user_data=None,user_id='97e87956414a49c4b3c34e51fe6ed2ec',uuid=a631dfd9-935a-444d-9b8e-082345fd4413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "address": "fa:16:3e:3d:fb:22", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e0cbd0-5c", "ovs_interfaceid": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Converting VIF {"id": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "address": "fa:16:3e:3d:fb:22", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e0cbd0-5c", "ovs_interfaceid": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=75e0cbd0-5c75-400a-94e3-4cf30eea2093,network=Network(25a51e04-88d5-45b8-865b-f2c7da7460b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e0cbd0-5c') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG os_vif [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=75e0cbd0-5c75-400a-94e3-4cf30eea2093,network=Network(25a51e04-88d5-45b8-865b-f2c7da7460b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e0cbd0-5c') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75e0cbd0-5c, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75e0cbd0-5c, col_values=(('external_ids', {'iface-id': '75e0cbd0-5c75-400a-94e3-4cf30eea2093', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:fb:22', 'vm-uuid': 'a631dfd9-935a-444d-9b8e-082345fd4413'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:38 user nova-compute[71325]: INFO os_vif [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=75e0cbd0-5c75-400a-94e3-4cf30eea2093,network=Network(25a51e04-88d5-45b8-865b-f2c7da7460b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e0cbd0-5c')
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:48:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] No VIF found with MAC fa:16:3e:3d:fb:22, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:48:39 user nova-compute[71325]: DEBUG nova.network.neutron [req-5a1aecf0-cbe8-40c5-82de-9de21ddb5806 req-f1dac193-7cae-4982-8959-f84c38615a03 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Updated VIF entry in instance network info cache for port 75e0cbd0-5c75-400a-94e3-4cf30eea2093. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:48:39 user nova-compute[71325]: DEBUG nova.network.neutron [req-5a1aecf0-cbe8-40c5-82de-9de21ddb5806 req-f1dac193-7cae-4982-8959-f84c38615a03 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Updating instance_info_cache with network_info: [{"id": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "address": "fa:16:3e:3d:fb:22", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e0cbd0-5c", "ovs_interfaceid": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:48:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5a1aecf0-cbe8-40c5-82de-9de21ddb5806 req-f1dac193-7cae-4982-8959-f84c38615a03 service nova] Releasing lock "refresh_cache-a631dfd9-935a-444d-9b8e-082345fd4413" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:48:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-3e083ced-17a0-4ddc-83c7-b0b9d7f0ceb3 req-9347120f-8d79-4383-acca-31872e4b16e5 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Received event network-vif-plugged-75e0cbd0-5c75-400a-94e3-4cf30eea2093 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3e083ced-17a0-4ddc-83c7-b0b9d7f0ceb3 req-9347120f-8d79-4383-acca-31872e4b16e5 service nova] Acquiring lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3e083ced-17a0-4ddc-83c7-b0b9d7f0ceb3 req-9347120f-8d79-4383-acca-31872e4b16e5 service nova] Lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3e083ced-17a0-4ddc-83c7-b0b9d7f0ceb3 req-9347120f-8d79-4383-acca-31872e4b16e5 service nova] Lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-3e083ced-17a0-4ddc-83c7-b0b9d7f0ceb3 req-9347120f-8d79-4383-acca-31872e4b16e5 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] No waiting events found dispatching network-vif-plugged-75e0cbd0-5c75-400a-94e3-4cf30eea2093 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:48:40 user nova-compute[71325]: WARNING nova.compute.manager [req-3e083ced-17a0-4ddc-83c7-b0b9d7f0ceb3 req-9347120f-8d79-4383-acca-31872e4b16e5 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Received unexpected event network-vif-plugged-75e0cbd0-5c75-400a-94e3-4cf30eea2093 for instance with vm_state building and task_state spawning.
Apr 13 21:48:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422522.57658, a631dfd9-935a-444d-9b8e-082345fd4413 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:48:42 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] VM Resumed (Lifecycle Event)
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:48:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Instance spawned successfully.
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-f57b284b-3f9d-448e-8fe0-30865bcb3271 req-571571ac-d465-4e84-831a-e8f72e799cbe service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Received event network-vif-plugged-75e0cbd0-5c75-400a-94e3-4cf30eea2093 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f57b284b-3f9d-448e-8fe0-30865bcb3271 req-571571ac-d465-4e84-831a-e8f72e799cbe service nova] Acquiring lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f57b284b-3f9d-448e-8fe0-30865bcb3271 req-571571ac-d465-4e84-831a-e8f72e799cbe service nova] Lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f57b284b-3f9d-448e-8fe0-30865bcb3271 req-571571ac-d465-4e84-831a-e8f72e799cbe service nova] Lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-f57b284b-3f9d-448e-8fe0-30865bcb3271 req-571571ac-d465-4e84-831a-e8f72e799cbe service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] No waiting events found dispatching network-vif-plugged-75e0cbd0-5c75-400a-94e3-4cf30eea2093 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:48:42 user nova-compute[71325]: WARNING nova.compute.manager [req-f57b284b-3f9d-448e-8fe0-30865bcb3271 req-571571ac-d465-4e84-831a-e8f72e799cbe service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Received unexpected event network-vif-plugged-75e0cbd0-5c75-400a-94e3-4cf30eea2093 for instance with vm_state building and task_state spawning.
Apr 13 21:48:42 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422522.5803874, a631dfd9-935a-444d-9b8e-082345fd4413 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:48:42 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] VM Started (Lifecycle Event)
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:48:42 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:48:42 user nova-compute[71325]: INFO nova.compute.manager [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Took 5.76 seconds to spawn the instance on the hypervisor.
Apr 13 21:48:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:48:42 user nova-compute[71325]: INFO nova.compute.manager [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Took 6.58 seconds to build instance.
Apr 13 21:48:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "a631dfd9-935a-444d-9b8e-082345fd4413" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.691s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-d501737d-8142-435c-a3ed-7d7c2cac6372 req-382b268c-6de8-4d43-80bd-663b44c65cc7 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-changed-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-d501737d-8142-435c-a3ed-7d7c2cac6372 req-382b268c-6de8-4d43-80bd-663b44c65cc7 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Refreshing instance network info cache due to event network-changed-a6dc784b-1fab-4f4b-8e84-8df1f191b373. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:48:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d501737d-8142-435c-a3ed-7d7c2cac6372 req-382b268c-6de8-4d43-80bd-663b44c65cc7 service nova] Acquiring lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:48:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d501737d-8142-435c-a3ed-7d7c2cac6372 req-382b268c-6de8-4d43-80bd-663b44c65cc7 service nova] Acquired lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:48:43 user nova-compute[71325]: DEBUG nova.network.neutron [req-d501737d-8142-435c-a3ed-7d7c2cac6372 req-382b268c-6de8-4d43-80bd-663b44c65cc7 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Refreshing network info cache for port a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:48:43 user nova-compute[71325]: DEBUG nova.network.neutron [req-d501737d-8142-435c-a3ed-7d7c2cac6372 req-382b268c-6de8-4d43-80bd-663b44c65cc7 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updated VIF entry in instance network info cache for port a6dc784b-1fab-4f4b-8e84-8df1f191b373. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:48:43 user nova-compute[71325]: DEBUG nova.network.neutron [req-d501737d-8142-435c-a3ed-7d7c2cac6372 req-382b268c-6de8-4d43-80bd-663b44c65cc7 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updating instance_info_cache with network_info: [{"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:48:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d501737d-8142-435c-a3ed-7d7c2cac6372 req-382b268c-6de8-4d43-80bd-663b44c65cc7 service nova] Releasing lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:48:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:45 user nova-compute[71325]: DEBUG nova.compute.manager [req-e93f1578-d6c4-4aec-a398-02fba202910d req-ee7b0572-5efe-48f4-abbd-e58e415932c6 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-changed-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:45 user nova-compute[71325]: DEBUG nova.compute.manager [req-e93f1578-d6c4-4aec-a398-02fba202910d req-ee7b0572-5efe-48f4-abbd-e58e415932c6 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Refreshing instance network info cache due to event network-changed-a6dc784b-1fab-4f4b-8e84-8df1f191b373. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:48:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e93f1578-d6c4-4aec-a398-02fba202910d req-ee7b0572-5efe-48f4-abbd-e58e415932c6 service nova] Acquiring lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:48:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e93f1578-d6c4-4aec-a398-02fba202910d req-ee7b0572-5efe-48f4-abbd-e58e415932c6 service nova] Acquired lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:48:45 user nova-compute[71325]: DEBUG nova.network.neutron [req-e93f1578-d6c4-4aec-a398-02fba202910d req-ee7b0572-5efe-48f4-abbd-e58e415932c6 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Refreshing network info cache for port a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:48:46 user nova-compute[71325]: DEBUG nova.network.neutron [req-e93f1578-d6c4-4aec-a398-02fba202910d req-ee7b0572-5efe-48f4-abbd-e58e415932c6 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updated VIF entry in instance network info cache for port a6dc784b-1fab-4f4b-8e84-8df1f191b373. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:48:46 user nova-compute[71325]: DEBUG nova.network.neutron [req-e93f1578-d6c4-4aec-a398-02fba202910d req-ee7b0572-5efe-48f4-abbd-e58e415932c6 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updating instance_info_cache with network_info: [{"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:48:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e93f1578-d6c4-4aec-a398-02fba202910d req-ee7b0572-5efe-48f4-abbd-e58e415932c6 service nova] Releasing lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:48:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "fe05a421-ee64-492b-a338-0e864458908c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:49 user nova-compute[71325]: INFO nova.compute.manager [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Rebooting instance
Apr 13 21:48:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquired lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG nova.network.neutron [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:49 user nova-compute[71325]: INFO nova.compute.manager [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Terminating instance
Apr 13 21:48:49 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG nova.network.neutron [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updating instance_info_cache with network_info: [{"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Releasing lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG nova.compute.manager [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-390b9282-10f6-4f89-bcf9-63949c8122ab req-33d71ab8-9b53-4db1-9f69-dd3be69a4b4e service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Received event network-vif-unplugged-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-390b9282-10f6-4f89-bcf9-63949c8122ab req-33d71ab8-9b53-4db1-9f69-dd3be69a4b4e service nova] Acquiring lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-390b9282-10f6-4f89-bcf9-63949c8122ab req-33d71ab8-9b53-4db1-9f69-dd3be69a4b4e service nova] Lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-390b9282-10f6-4f89-bcf9-63949c8122ab req-33d71ab8-9b53-4db1-9f69-dd3be69a4b4e service nova] Lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-390b9282-10f6-4f89-bcf9-63949c8122ab req-33d71ab8-9b53-4db1-9f69-dd3be69a4b4e service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] No waiting events found dispatching network-vif-unplugged-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-390b9282-10f6-4f89-bcf9-63949c8122ab req-33d71ab8-9b53-4db1-9f69-dd3be69a4b4e service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Received event network-vif-unplugged-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Instance destroyed successfully.
Apr 13 21:48:50 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lazy-loading 'resources' on Instance uuid eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-386129097',display_name='tempest-ServersNegativeTestJSON-server-386129097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-386129097',id=13,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:47:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1071d640fb44ff9966fab7888668ed5',ramdisk_id='',reservation_id='r-xfcgg0aj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1571285098',owner_user_name='tempest-ServersNegativeTestJSON-1571285098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:47:09Z,user_data=None,user_id='02a7fc7a42b441cfa3c6bc04f4dd6cb9',uuid=eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "address": "fa:16:3e:9a:e4:f0", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dfaa3c7-5c", "ovs_interfaceid": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Converting VIF {"id": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "address": "fa:16:3e:9a:e4:f0", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dfaa3c7-5c", "ovs_interfaceid": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e4:f0,bridge_name='br-int',has_traffic_filtering=True,id=2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea,network=Network(ed9169cc-af6d-4d31-9b2e-9016c5f963c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dfaa3c7-5c') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG os_vif [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e4:f0,bridge_name='br-int',has_traffic_filtering=True,id=2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea,network=Network(ed9169cc-af6d-4d31-9b2e-9016c5f963c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dfaa3c7-5c') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dfaa3c7-5c, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:50 user nova-compute[71325]: INFO os_vif [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e4:f0,bridge_name='br-int',has_traffic_filtering=True,id=2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea,network=Network(ed9169cc-af6d-4d31-9b2e-9016c5f963c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dfaa3c7-5c')
Apr 13 21:48:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Deleting instance files /opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f_del
Apr 13 21:48:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Deletion of /opt/stack/data/nova/instances/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f_del complete
Apr 13 21:48:50 user nova-compute[71325]: INFO nova.compute.manager [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 13 21:48:50 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:48:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: fe05a421-ee64-492b-a338-0e864458908c] Instance destroyed successfully.
Apr 13 21:48:50 user nova-compute[71325]: DEBUG nova.objects.instance [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'resources' on Instance uuid fe05a421-ee64-492b-a338-0e864458908c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1041715874',display_name='tempest-TestMinimumBasicScenario-server-1041715874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1041715874',id=12,image_ref='151f8298-2e7c-4c5b-b82a-496f9533b342',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrF4HyOOJH3pMivnghQrjFo+W8h3ND4pdRgXep1SFS8/WTYjcNCQm2ws2bOjH7uTrYfCv8CUrUqbd3voRDTocx9SqboUPZF+TWklO/M1CRGmsArlRpxU4SyKxVWG+qBZw==',key_name='tempest-TestMinimumBasicScenario-1695743106',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:46:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d4e8c27ff7d4fa9a61e000c9d02c5f4',ramdisk_id='',reservation_id='r-vzgmgg3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='151f8298-2e7c-4c5b-b82a-496f9533b342',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1800545339',owner_user_name='tempest-TestMinimumBasicScenario-1800545339-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:48:50Z,user_data=None,user_id='710e0446cf794e94b3ab29bb0d7e10d8',uuid=fe05a421-ee64-492b-a338-0e864458908c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converting VIF {"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:dc:b4,bridge_name='br-int',has_traffic_filtering=True,id=a6dc784b-1fab-4f4b-8e84-8df1f191b373,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc784b-1f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG os_vif [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:dc:b4,bridge_name='br-int',has_traffic_filtering=True,id=a6dc784b-1fab-4f4b-8e84-8df1f191b373,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc784b-1f') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6dc784b-1f, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:50 user nova-compute[71325]: INFO os_vif [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:dc:b4,bridge_name='br-int',has_traffic_filtering=True,id=a6dc784b-1fab-4f4b-8e84-8df1f191b373,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc784b-1f')
Apr 13 21:48:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUdWXroA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:48:50 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:48:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6a7d3a-62c6-49ad-9c1b-5cf0ba9038ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:48:50 user nova-compute[71325]: No targets found.
Apr 13 21:48:50 user nova-compute[71325]: iSNS:
Apr 13 21:48:50 user nova-compute[71325]: No targets found.
Apr 13 21:48:50 user nova-compute[71325]: STATIC:
Apr 13 21:48:50 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae
Apr 13 21:48:50 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:48:50 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:48:50 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c
Apr 13 21:48:50 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:48:50 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:48:50 user nova-compute[71325]: FIRMWARE:
Apr 13 21:48:50 user nova-compute[71325]: No targets found.
Apr 13 21:48:50 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:48:50 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:48:50 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG nova.compute.manager [req-4b3644e1-045b-47e8-b967-6975cf949cbc req-5e2e9448-3d30-4c77-af33-c93d7a714294 service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Received event network-vif-deleted-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:50 user nova-compute[71325]: INFO nova.compute.manager [req-4b3644e1-045b-47e8-b967-6975cf949cbc req-5e2e9448-3d30-4c77-af33-c93d7a714294 service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Neutron deleted interface 2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea; detaching it from the instance and deleting it from the info cache
Apr 13 21:48:50 user nova-compute[71325]: DEBUG nova.network.neutron [req-4b3644e1-045b-47e8-b967-6975cf949cbc req-5e2e9448-3d30-4c77-af33-c93d7a714294 service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:48:50 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Took 0.59 seconds to deallocate network for instance.
Apr 13 21:48:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa79800-6f11-4e3c-9e87-7c3641158b34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f787f58-7322-4562-9ccb-18099fede0db]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:48:51 user nova-compute[71325]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:51 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:48:51 user nova-compute[71325]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:51 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c4434ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c'): ({'sdc'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Removing single pathed devices sdc {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-4b3644e1-045b-47e8-b967-6975cf949cbc req-5e2e9448-3d30-4c77-af33-c93d7a714294 service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Detach interface failed, port_id=2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea, reason: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2aa86b-e5a3-4278-bb3a-9c93edf603a9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[937cead3-478b-4b38-be50-f64803cffaf8]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Flushing IO for device /dev/sdc {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ec8609-7213-46ef-b018-135855bf3166]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[40527887-e8f2-42ea-b30e-74e46b8ab97c]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[433fc72c-fe18-414b-a59e-3b62a6054adb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1038aac2-cc32-4bbd-8428-3c3bf326d58e]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260]
Apr 13 21:48:51 user nova-compute[71325]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260] successful.
Apr 13 21:48:51 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c00da1b-c536-447d-9da3-bdcab5c09205]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] <== disconnect_volume: return (373ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Start _get_guest_xml network_info=[{"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=151f8298-2e7c-4c5b-b82a-496f9533b342,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '151f8298-2e7c-4c5b-b82a-496f9533b342'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUdWXroA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'fe05a421-ee64-492b-a338-0e864458908c', 'attached_at': '', 'detached_at': '', 'volume_id': '58713f9a-6c26-4fe7-a2bc-967c96ddcc4c', 'serial': '58713f9a-6c26-4fe7-a2bc-967c96ddcc4c'}, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'a70cb2d6-506b-4b9d-a1b7-5ce4215e40b3', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "ff61d99e-4db9-421f-8c01-264a7278c095" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "ff61d99e-4db9-421f-8c01-264a7278c095" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:51 user nova-compute[71325]: INFO nova.compute.manager [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Terminating instance
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:48:51 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:48:51 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=151f8298-2e7c-4c5b-b82a-496f9533b342,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.objects.instance [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'vcpu_model' on Instance uuid fe05a421-ee64-492b-a338-0e864458908c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUdWXroA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:48:51 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:48:51 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:48:51 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:48:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1601034-91d1-4336-a769-4fa320b1c479]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:48:51 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[da340dfa-ec7b-4061-a6da-5c67228c23fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c] added
Apr 13 21:48:51 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebf185b-a98c-4759-a418-6234c345fb36]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f277cdb7-7e73-45d7-be5d-e930b3b38341]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FUdWXroA {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FUdWXroA" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[41519731-2da9-4965-b5a4-bd9d577d6c45]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FUdWXroA'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.551s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd2d4a5-132e-4ec8-88df-99736db09535]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2aa6c0-38ec-4d38-adca-9a774faf4e22]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:51 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:51 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:48:51 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Deleted allocations for instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2bde7a-a7c1-49eb-a909-173d45c07f1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260]
Apr 13 21:48:51 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260] successful.
Apr 13 21:48:51 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e9bb7e-38ec-4d35-8e54-d27d534e07b6]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b722ee-7a6e-4c23-bd9a-b00a56d8315f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:48:51 user nova-compute[71325]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:51 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:48:51 user nova-compute[71325]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:48:51 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c258a638-1a5e-44da-96c2-eae67535f578]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUdWXroA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Received event network-vif-plugged-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Acquiring lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Lock "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] No waiting events found dispatching network-vif-plugged-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:48:51 user nova-compute[71325]: WARNING nova.compute.manager [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Received unexpected event network-vif-plugged-2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea for instance with vm_state deleted and task_state None.
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-vif-unplugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] No waiting events found dispatching network-vif-unplugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:48:51 user nova-compute[71325]: WARNING nova.compute.manager [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received unexpected event network-vif-unplugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] No waiting events found dispatching network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:48:51 user nova-compute[71325]: WARNING nova.compute.manager [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received unexpected event network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 21:48:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Instance destroyed successfully.
Apr 13 21:48:52 user nova-compute[71325]: DEBUG nova.objects.instance [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lazy-loading 'resources' on Instance uuid ff61d99e-4db9-421f-8c01-264a7278c095 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-155987669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-155987669',id=11,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv5A5QM89WDKnsULhMuooVL+m28bgPV7OihZIzGssK7PgLTiXl/GrJAAaMRdz+PYZbhzGzt+oX5wWpDIz3NkiaY2vLH+14jBnJVm8Ym0U0jNo9V6zKnqyN1OlYdbXBS3Q==',key_name='tempest-keypair-1492294196',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fd0897baf2c455c87ac9a330a673d8e',ramdisk_id='',reservation_id='r-jqdpikg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1835832502',owner_user_name='tempest-TaggedAttachmentsTest-1835832502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18587f4671a34f568e00dbee3f33eb8b',uuid=ff61d99e-4db9-421f-8c01-264a7278c095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "address": "fa:16:3e:a2:5a:69", "network": {"id": "887fc8b4-07a7-4f28-8a55-c09dc080941e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-632369901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c222f8e-f6", "ovs_interfaceid": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Converting VIF {"id": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "address": "fa:16:3e:a2:5a:69", "network": {"id": "887fc8b4-07a7-4f28-8a55-c09dc080941e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-632369901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fd0897baf2c455c87ac9a330a673d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c222f8e-f6", "ovs_interfaceid": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:5a:69,bridge_name='br-int',has_traffic_filtering=True,id=8c222f8e-f61d-4b04-87c4-edd1ca83b22b,network=Network(887fc8b4-07a7-4f28-8a55-c09dc080941e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c222f8e-f6') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG os_vif [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:5a:69,bridge_name='br-int',has_traffic_filtering=True,id=8c222f8e-f61d-4b04-87c4-edd1ca83b22b,network=Network(887fc8b4-07a7-4f28-8a55-c09dc080941e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c222f8e-f6') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c222f8e-f6, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:52 user nova-compute[71325]: INFO os_vif [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:5a:69,bridge_name='br-int',has_traffic_filtering=True,id=8c222f8e-f61d-4b04-87c4-edd1ca83b22b,network=Network(887fc8b4-07a7-4f28-8a55-c09dc080941e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c222f8e-f6')
Apr 13 21:48:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Deleting instance files /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095_del
Apr 13 21:48:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Deletion of /opt/stack/data/nova/instances/ff61d99e-4db9-421f-8c01-264a7278c095_del complete
Apr 13 21:48:52 user nova-compute[71325]: INFO nova.compute.manager [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 21:48:52 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26139663931346235', 'path': '/dev/sdc'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139663931346235', 'path': '/dev/sdc'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1041715874',display_name='tempest-TestMinimumBasicScenario-server-1041715874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1041715874',id=12,image_ref='151f8298-2e7c-4c5b-b82a-496f9533b342',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrF4HyOOJH3pMivnghQrjFo+W8h3ND4pdRgXep1SFS8/WTYjcNCQm2ws2bOjH7uTrYfCv8CUrUqbd3voRDTocx9SqboUPZF+TWklO/M1CRGmsArlRpxU4SyKxVWG+qBZw==',key_name='tempest-TestMinimumBasicScenario-1695743106',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:46:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d4e8c27ff7d4fa9a61e000c9d02c5f4',ramdisk_id='',reservation_id='r-vzgmgg3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='151f8298-2e7c-4c5b-b82a-496f9533b342',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1800545339',owner_user_name='tempest-TestMinimumBasicScenario-1800545339-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:48:50Z,user_data=None,user_id='710e0446cf794e94b3ab29bb0d7e10d8',uuid=fe05a421-ee64-492b-a338-0e864458908c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converting VIF {"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:dc:b4,bridge_name='br-int',has_traffic_filtering=True,id=a6dc784b-1fab-4f4b-8e84-8df1f191b373,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc784b-1f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG nova.objects.instance [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'pci_devices' on Instance uuid fe05a421-ee64-492b-a338-0e864458908c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:48:52 user nova-compute[71325]:   <uuid>fe05a421-ee64-492b-a338-0e864458908c</uuid>
Apr 13 21:48:52 user nova-compute[71325]:   <name>instance-0000000c</name>
Apr 13 21:48:52 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:48:52 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:48:52 user nova-compute[71325]:   <metadata>
Apr 13 21:48:52 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:48:52 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:48:52 user nova-compute[71325]:       <nova:name>tempest-TestMinimumBasicScenario-server-1041715874</nova:name>
Apr 13 21:48:52 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:48:51</nova:creationTime>
Apr 13 21:48:52 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:48:52 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:48:52 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:48:52 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:48:52 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:48:52 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:48:52 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:48:52 user nova-compute[71325]:       <nova:owner>
Apr 13 21:48:52 user nova-compute[71325]:         <nova:user uuid="710e0446cf794e94b3ab29bb0d7e10d8">tempest-TestMinimumBasicScenario-1800545339-project-member</nova:user>
Apr 13 21:48:52 user nova-compute[71325]:         <nova:project uuid="7d4e8c27ff7d4fa9a61e000c9d02c5f4">tempest-TestMinimumBasicScenario-1800545339</nova:project>
Apr 13 21:48:52 user nova-compute[71325]:       </nova:owner>
Apr 13 21:48:52 user nova-compute[71325]:       <nova:root type="image" uuid="151f8298-2e7c-4c5b-b82a-496f9533b342"/>
Apr 13 21:48:52 user nova-compute[71325]:       <nova:ports>
Apr 13 21:48:52 user nova-compute[71325]:         <nova:port uuid="a6dc784b-1fab-4f4b-8e84-8df1f191b373">
Apr 13 21:48:52 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 21:48:52 user nova-compute[71325]:         </nova:port>
Apr 13 21:48:52 user nova-compute[71325]:       </nova:ports>
Apr 13 21:48:52 user nova-compute[71325]:     </nova:instance>
Apr 13 21:48:52 user nova-compute[71325]:   </metadata>
Apr 13 21:48:52 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:48:52 user nova-compute[71325]:     <system>
Apr 13 21:48:52 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:48:52 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:48:52 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:48:52 user nova-compute[71325]:       <entry name="serial">fe05a421-ee64-492b-a338-0e864458908c</entry>
Apr 13 21:48:52 user nova-compute[71325]:       <entry name="uuid">fe05a421-ee64-492b-a338-0e864458908c</entry>
Apr 13 21:48:52 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:48:52 user nova-compute[71325]:     </system>
Apr 13 21:48:52 user nova-compute[71325]:   </sysinfo>
Apr 13 21:48:52 user nova-compute[71325]:   <os>
Apr 13 21:48:52 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:48:52 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:48:52 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:48:52 user nova-compute[71325]:   </os>
Apr 13 21:48:52 user nova-compute[71325]:   <features>
Apr 13 21:48:52 user nova-compute[71325]:     <acpi/>
Apr 13 21:48:52 user nova-compute[71325]:     <apic/>
Apr 13 21:48:52 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:48:52 user nova-compute[71325]:   </features>
Apr 13 21:48:52 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:48:52 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:48:52 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:48:52 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:48:52 user nova-compute[71325]:   </clock>
Apr 13 21:48:52 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:48:52 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:48:52 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:48:52 user nova-compute[71325]:   </cpu>
Apr 13 21:48:52 user nova-compute[71325]:   <devices>
Apr 13 21:48:52 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:48:52 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:48:52 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk"/>
Apr 13 21:48:52 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:48:52 user nova-compute[71325]:     </disk>
Apr 13 21:48:52 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:48:52 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:48:52 user nova-compute[71325]:       <source dev="/dev/sdc"/>
Apr 13 21:48:52 user nova-compute[71325]:       <target dev="vdb" bus="virtio"/>
Apr 13 21:48:52 user nova-compute[71325]:       <serial>58713f9a-6c26-4fe7-a2bc-967c96ddcc4c</serial>
Apr 13 21:48:52 user nova-compute[71325]:     </disk>
Apr 13 21:48:52 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:48:52 user nova-compute[71325]:       <mac address="fa:16:3e:cf:dc:b4"/>
Apr 13 21:48:52 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:48:52 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:48:52 user nova-compute[71325]:       <target dev="tapa6dc784b-1f"/>
Apr 13 21:48:52 user nova-compute[71325]:     </interface>
Apr 13 21:48:52 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:48:52 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/console.log" append="off"/>
Apr 13 21:48:52 user nova-compute[71325]:     </serial>
Apr 13 21:48:52 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:48:52 user nova-compute[71325]:     <video>
Apr 13 21:48:52 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:48:52 user nova-compute[71325]:     </video>
Apr 13 21:48:52 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:48:52 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:48:52 user nova-compute[71325]:     </rng>
Apr 13 21:48:52 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:48:52 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:48:52 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:48:52 user nova-compute[71325]:     </memballoon>
Apr 13 21:48:52 user nova-compute[71325]:   </devices>
Apr 13 21:48:52 user nova-compute[71325]: </domain>
Apr 13 21:48:52 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received event network-vif-unplugged-8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] Acquiring lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] No waiting events found dispatching network-vif-unplugged-8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received event network-vif-unplugged-8c222f8e-f61d-4b04-87c4-edd1ca83b22b for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received event network-vif-plugged-8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] Acquiring lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] Lock "ff61d99e-4db9-421f-8c01-264a7278c095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] No waiting events found dispatching network-vif-plugged-8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:48:53 user nova-compute[71325]: WARNING nova.compute.manager [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received unexpected event network-vif-plugged-8c222f8e-f61d-4b04-87c4-edd1ca83b22b for instance with vm_state active and task_state deleting.
Apr 13 21:48:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.objects.instance [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'trusted_certs' on Instance uuid fe05a421-ee64-492b-a338-0e864458908c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0 --force-share --output=json" returned: 0 in 0.155s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:48:53 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Took 1.25 seconds to deallocate network for instance.
Apr 13 21:48:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Cannot resize image /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.objects.instance [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'migration_context' on Instance uuid fe05a421-ee64-492b-a338-0e864458908c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1041715874',display_name='tempest-TestMinimumBasicScenario-server-1041715874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1041715874',id=12,image_ref='151f8298-2e7c-4c5b-b82a-496f9533b342',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrF4HyOOJH3pMivnghQrjFo+W8h3ND4pdRgXep1SFS8/WTYjcNCQm2ws2bOjH7uTrYfCv8CUrUqbd3voRDTocx9SqboUPZF+TWklO/M1CRGmsArlRpxU4SyKxVWG+qBZw==',key_name='tempest-TestMinimumBasicScenario-1695743106',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:46:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='7d4e8c27ff7d4fa9a61e000c9d02c5f4',ramdisk_id='',reservation_id='r-vzgmgg3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='151f8298-2e7c-4c5b-b82a-496f9533b342',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1800545339',owner_user_name='tempest-TestMinimumBasicScenario-1800545339-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:48:50Z,user_data=None,user_id='710e0446cf794e94b3ab29bb0d7e10d8',uuid=fe05a421-ee64-492b-a338-0e864458908c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converting VIF {"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:dc:b4,bridge_name='br-int',has_traffic_filtering=True,id=a6dc784b-1fab-4f4b-8e84-8df1f191b373,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc784b-1f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG os_vif [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:dc:b4,bridge_name='br-int',has_traffic_filtering=True,id=a6dc784b-1fab-4f4b-8e84-8df1f191b373,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc784b-1f') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6dc784b-1f, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6dc784b-1f, col_values=(('external_ids', {'iface-id': 'a6dc784b-1fab-4f4b-8e84-8df1f191b373', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:dc:b4', 'vm-uuid': 'fe05a421-ee64-492b-a338-0e864458908c'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:53 user nova-compute[71325]: INFO os_vif [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:dc:b4,bridge_name='br-int',has_traffic_filtering=True,id=a6dc784b-1fab-4f4b-8e84-8df1f191b373,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc784b-1f')
Apr 13 21:48:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:48:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:53 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Deleted allocations for instance ff61d99e-4db9-421f-8c01-264a7278c095
Apr 13 21:48:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "ff61d99e-4db9-421f-8c01-264a7278c095" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.756s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-96f35930-dd3f-48e2-b026-40c581e4aefc req-8575ba3a-55bb-4212-9ef0-05137e3bf861 service nova] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Received event network-vif-deleted-8c222f8e-f61d-4b04-87c4-edd1ca83b22b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-52a2d7f0-96d2-45bb-9520-c84587e1bb99 req-4c5bcbd1-ead4-494a-953c-cc2413b9ddba service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-52a2d7f0-96d2-45bb-9520-c84587e1bb99 req-4c5bcbd1-ead4-494a-953c-cc2413b9ddba service nova] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-52a2d7f0-96d2-45bb-9520-c84587e1bb99 req-4c5bcbd1-ead4-494a-953c-cc2413b9ddba service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-52a2d7f0-96d2-45bb-9520-c84587e1bb99 req-4c5bcbd1-ead4-494a-953c-cc2413b9ddba service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-52a2d7f0-96d2-45bb-9520-c84587e1bb99 req-4c5bcbd1-ead4-494a-953c-cc2413b9ddba service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] No waiting events found dispatching network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:48:55 user nova-compute[71325]: WARNING nova.compute.manager [req-52a2d7f0-96d2-45bb-9520-c84587e1bb99 req-4c5bcbd1-ead4-494a-953c-cc2413b9ddba service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received unexpected event network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 21:48:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for fe05a421-ee64-492b-a338-0e864458908c due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:48:57 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422537.2245662, fe05a421-ee64-492b-a338-0e864458908c => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:48:57 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] VM Resumed (Lifecycle Event)
Apr 13 21:48:57 user nova-compute[71325]: DEBUG nova.compute.manager [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:48:57 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: fe05a421-ee64-492b-a338-0e864458908c] Instance rebooted successfully.
Apr 13 21:48:57 user nova-compute[71325]: DEBUG nova.compute.manager [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:48:57 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:48:57 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:48:57 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 13 21:48:57 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422537.2293327, fe05a421-ee64-492b-a338-0e864458908c => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:48:57 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] VM Started (Lifecycle Event)
Apr 13 21:48:57 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:48:57 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:48:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "fe05a421-ee64-492b-a338-0e864458908c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.093s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:57 user nova-compute[71325]: DEBUG nova.compute.manager [req-aef09fdb-f5d8-4c98-965a-131b38cb5dac req-f2191829-a84f-4078-a48b-3c2f57bfb9d9 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:48:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aef09fdb-f5d8-4c98-965a-131b38cb5dac req-f2191829-a84f-4078-a48b-3c2f57bfb9d9 service nova] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aef09fdb-f5d8-4c98-965a-131b38cb5dac req-f2191829-a84f-4078-a48b-3c2f57bfb9d9 service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aef09fdb-f5d8-4c98-965a-131b38cb5dac req-f2191829-a84f-4078-a48b-3c2f57bfb9d9 service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:57 user nova-compute[71325]: DEBUG nova.compute.manager [req-aef09fdb-f5d8-4c98-965a-131b38cb5dac req-f2191829-a84f-4078-a48b-3c2f57bfb9d9 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] No waiting events found dispatching network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:48:57 user nova-compute[71325]: WARNING nova.compute.manager [req-aef09fdb-f5d8-4c98-965a-131b38cb5dac req-f2191829-a84f-4078-a48b-3c2f57bfb9d9 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received unexpected event network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance with vm_state active and task_state None.
Apr 13 21:48:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:58 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:48:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "35820c1d-307d-43ed-b3d1-31fe12602870" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "35820c1d-307d-43ed-b3d1-31fe12602870" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:59 user nova-compute[71325]: INFO nova.compute.manager [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Terminating instance
Apr 13 21:48:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:48:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:59 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:48:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:48:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:48:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:48:59 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:48:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:48:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-2acbf9a7-632e-482f-aa5a-656c0af83668 req-cd437e1e-aef0-4ddf-a0fa-8e393c6d4fa5 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Received event network-vif-unplugged-015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2acbf9a7-632e-482f-aa5a-656c0af83668 req-cd437e1e-aef0-4ddf-a0fa-8e393c6d4fa5 service nova] Acquiring lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2acbf9a7-632e-482f-aa5a-656c0af83668 req-cd437e1e-aef0-4ddf-a0fa-8e393c6d4fa5 service nova] Lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2acbf9a7-632e-482f-aa5a-656c0af83668 req-cd437e1e-aef0-4ddf-a0fa-8e393c6d4fa5 service nova] Lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-2acbf9a7-632e-482f-aa5a-656c0af83668 req-cd437e1e-aef0-4ddf-a0fa-8e393c6d4fa5 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] No waiting events found dispatching network-vif-unplugged-015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-2acbf9a7-632e-482f-aa5a-656c0af83668 req-cd437e1e-aef0-4ddf-a0fa-8e393c6d4fa5 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Received event network-vif-unplugged-015b54d3-245f-448a-b918-e53aaeed180f for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:49:00 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Instance destroyed successfully.
Apr 13 21:49:00 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lazy-loading 'resources' on Instance uuid 35820c1d-307d-43ed-b3d1-31fe12602870 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1884922287',display_name='tempest-TestVolumeSwap-server-1884922287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1884922287',id=8,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWC+Lq7pJ4WDwThJOzr5RF5FYGRTvTjYRBB7k91qrhwtm+D5lvNsjF+j5p20b80DTf/2gxHyYmsifkpGYyU2u3wq7jDQvSYZvn/fEGzUyBeRiZKX/bAu5xuVFp32HZsXw==',key_name='tempest-keypair-1807131148',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec8cec16877149a6824b9292c1065c13',ramdisk_id='',reservation_id='r-vbezl4f1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1367203583',owner_user_name='tempest-TestVolumeSwap-1367203583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:45:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5b255efcd6b4033ba11cc64eb376a89',uuid=35820c1d-307d-43ed-b3d1-31fe12602870,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "015b54d3-245f-448a-b918-e53aaeed180f", "address": "fa:16:3e:fa:b5:73", "network": {"id": "2c235eb0-e303-4d17-a1d6-b2a05c1adeb5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1743492804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8cec16877149a6824b9292c1065c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b54d3-24", "ovs_interfaceid": "015b54d3-245f-448a-b918-e53aaeed180f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Converting VIF {"id": "015b54d3-245f-448a-b918-e53aaeed180f", "address": "fa:16:3e:fa:b5:73", "network": {"id": "2c235eb0-e303-4d17-a1d6-b2a05c1adeb5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1743492804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8cec16877149a6824b9292c1065c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b54d3-24", "ovs_interfaceid": "015b54d3-245f-448a-b918-e53aaeed180f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:b5:73,bridge_name='br-int',has_traffic_filtering=True,id=015b54d3-245f-448a-b918-e53aaeed180f,network=Network(2c235eb0-e303-4d17-a1d6-b2a05c1adeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b54d3-24') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG os_vif [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:b5:73,bridge_name='br-int',has_traffic_filtering=True,id=015b54d3-245f-448a-b918-e53aaeed180f,network=Network(2c235eb0-e303-4d17-a1d6-b2a05c1adeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b54d3-24') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap015b54d3-24, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:00 user nova-compute[71325]: INFO os_vif [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:b5:73,bridge_name='br-int',has_traffic_filtering=True,id=015b54d3-245f-448a-b918-e53aaeed180f,network=Network(2c235eb0-e303-4d17-a1d6-b2a05c1adeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b54d3-24')
Apr 13 21:49:00 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Deleting instance files /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870_del
Apr 13 21:49:00 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Deletion of /opt/stack/data/nova/instances/35820c1d-307d-43ed-b3d1-31fe12602870_del complete
Apr 13 21:49:00 user nova-compute[71325]: INFO nova.compute.manager [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 13 21:49:00 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:01 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Error from libvirt while getting description of instance-00000008: [Error Code 42] Domain not found: no domain with matching uuid '35820c1d-307d-43ed-b3d1-31fe12602870' (instance-00000008): libvirt.libvirtError: Domain not found: no domain with matching uuid '35820c1d-307d-43ed-b3d1-31fe12602870' (instance-00000008)
Apr 13 21:49:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG nova.compute.manager [req-ba035990-69c7-412b-8844-7d41b5088316 req-5cf0d2f8-58cb-4669-aab0-61be14175592 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Received event network-vif-plugged-015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ba035990-69c7-412b-8844-7d41b5088316 req-5cf0d2f8-58cb-4669-aab0-61be14175592 service nova] Acquiring lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ba035990-69c7-412b-8844-7d41b5088316 req-5cf0d2f8-58cb-4669-aab0-61be14175592 service nova] Lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ba035990-69c7-412b-8844-7d41b5088316 req-5cf0d2f8-58cb-4669-aab0-61be14175592 service nova] Lock "35820c1d-307d-43ed-b3d1-31fe12602870-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG nova.compute.manager [req-ba035990-69c7-412b-8844-7d41b5088316 req-5cf0d2f8-58cb-4669-aab0-61be14175592 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] No waiting events found dispatching network-vif-plugged-015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:02 user nova-compute[71325]: WARNING nova.compute.manager [req-ba035990-69c7-412b-8844-7d41b5088316 req-5cf0d2f8-58cb-4669-aab0-61be14175592 service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Received unexpected event network-vif-plugged-015b54d3-245f-448a-b918-e53aaeed180f for instance with vm_state active and task_state deleting.
Apr 13 21:49:02 user nova-compute[71325]: DEBUG nova.compute.manager [req-207ca2b8-3dca-4a1c-a667-b4489f3046f1 req-733121a0-6d1b-4bce-9766-d528b8d55a0f service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Received event network-vif-deleted-015b54d3-245f-448a-b918-e53aaeed180f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:02 user nova-compute[71325]: INFO nova.compute.manager [req-207ca2b8-3dca-4a1c-a667-b4489f3046f1 req-733121a0-6d1b-4bce-9766-d528b8d55a0f service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Neutron deleted interface 015b54d3-245f-448a-b918-e53aaeed180f; detaching it from the instance and deleting it from the info cache
Apr 13 21:49:02 user nova-compute[71325]: DEBUG nova.network.neutron [req-207ca2b8-3dca-4a1c-a667-b4489f3046f1 req-733121a0-6d1b-4bce-9766-d528b8d55a0f service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG nova.compute.manager [req-207ca2b8-3dca-4a1c-a667-b4489f3046f1 req-733121a0-6d1b-4bce-9766-d528b8d55a0f service nova] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Detach interface failed, port_id=015b54d3-245f-448a-b918-e53aaeed180f, reason: Instance 35820c1d-307d-43ed-b3d1-31fe12602870 could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:49:02 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Took 1.72 seconds to deallocate network for instance.
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.744s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:03 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Deleted allocations for instance 35820c1d-307d-43ed-b3d1-31fe12602870
Apr 13 21:49:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "35820c1d-307d-43ed-b3d1-31fe12602870" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.653s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:49:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:04 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:49:04 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7807MB free_disk=26.37114715576172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance be81f393-654b-4b50-856e-00818f3ae59e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance fe05a421-ee64-492b-a338-0e864458908c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance a631dfd9-935a-444d-9b8e-082345fd4413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:49:04 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'flavor' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquired lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'info_cache' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:05 user nova-compute[71325]: INFO nova.compute.manager [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Unshelving
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.394s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:49:05 user nova-compute[71325]: INFO nova.compute.claims [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Claim successful on node user
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422530.2291791, eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:49:05 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] VM Stopped (Lifecycle Event)
Apr 13 21:49:05 user nova-compute[71325]: INFO nova.virt.block_device [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Booting with volume a325d973-036d-409b-af0a-cae00a2d5474 at /dev/vdc
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-31a99a3e-2028-4a30-b04e-a54e3cb8a878 None None] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.utils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a5cf87-b9a7-4a34-9ed1-bd00933ab104]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11c05aa-da70-45df-a8f6-c67d446a88a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b08962d-d4cb-44e3-b6a0-d795872abfb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f225b52-acac-498c-954b-5ab7c65f4cd2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:49:05 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd35ded4-f506-4e64-ac8f-ba29fea35b80]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.utils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updating existing volume attachment record: 05b8afc4-ca5e-4d02-8b2f-b6f976ea465d {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Updating instance_info_cache with network_info: [{"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Releasing lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:49:05 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Instance destroyed successfully.
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'resources' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-140399517',display_name='tempest-AttachVolumeTestJSON-server-140399517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-140399517',id=3,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtoB3nR0JKHa6Ky1vXPwyI7w+rB3Ypa07sW6QVuaj3CXiFeuqRSmd55pQSr/lvFo9l5efcEiAn2oFJFeJlQXi0+ollyvkUFol9Z6nrTwTO2rVl/RiddJVHfv6WKf61UrQ==',key_name='tempest-keypair-789187285',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3605d609b52b431993bcea0798a77554',ramdisk_id='',reservation_id='r-gimed3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-249879422',owner_user_name='tempest-AttachVolumeTestJSON-249879422-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60e4dadf9d9e41e6a91ee03a0cd50dc3',uuid=ddc7aa71-95a1-4a3c-a5c1-746b86a011c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converting VIF {"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_vif [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa70898ac-83, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:49:05 user nova-compute[71325]: INFO os_vif [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83')
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwMuKBIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:49:05 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.objects.instance [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'flavor' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bbc022-e752-42cc-97ea-3033de4787bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:49:05 user nova-compute[71325]: No targets found.
Apr 13 21:49:05 user nova-compute[71325]: iSNS:
Apr 13 21:49:05 user nova-compute[71325]: No targets found.
Apr 13 21:49:05 user nova-compute[71325]: STATIC:
Apr 13 21:49:05 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae
Apr 13 21:49:05 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:49:05 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:49:05 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c
Apr 13 21:49:05 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:49:05 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:49:05 user nova-compute[71325]: FIRMWARE:
Apr 13 21:49:05 user nova-compute[71325]: No targets found.
Apr 13 21:49:05 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:49:05 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:49:05 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:05 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d7a7f5-76b7-4e3f-a695-08902d8c925f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3151199d-daf5-4072-ae4d-6263406864da]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:05 user nova-compute[71325]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:49:05 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:05 user nova-compute[71325]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:49:05 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7e8caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bcf24f-29fa-4cb3-8cda-fde858d36bce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.policy [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fba48d6-c1a8-46ff-9d8c-8cc8d2df05ad]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df0de08-cc82-498a-955e-8221708d1657]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:49:05 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Creating image(s)
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "/opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "/opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:05 user nova-compute[71325]: INFO nova.compute.manager [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Attaching volume 5b928772-e4f8-489b-93b3-282f3c7c184b to /dev/vdb
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade0a893-9bb1-47bc-9182-bbff5660001a]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0be018-38f1-4da5-98e9-a94c07e983bc]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.utils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5f40eb-d8ce-412f-95bd-445aa54a29b2]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260]
Apr 13 21:49:06 user nova-compute[71325]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260] successful.
Apr 13 21:49:06 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b3775a-b6e6-47a7-83da-cb4eb58b61bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3648f6b-5df7-4ce6-af4b-0f13556181a0]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3815bb-2e09-4cfe-aba1-2d84384bc144]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] <== disconnect_volume: return (395ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Start _get_guest_xml network_info=[{"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwMuKBIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ddc7aa71-95a1-4a3c-a5c1-746b86a011c2', 'attached_at': '', 'detached_at': '', 'volume_id': '5c84a9a6-d73f-46ba-b157-ba2642a6a5ae', 'serial': '5c84a9a6-d73f-46ba-b157-ba2642a6a5ae'}, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '69bd7a81-7d84-4e52-a21e-1d9e44697a06', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'numa_topology' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b09351-139f-421d-93c2-cc46fbe55d7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d25a878-b45a-41ca-b246-01567efc5943]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:49:06 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bafa0e9-3d38-4f9d-9832-7ec72206556c]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:49:06 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'vcpu_model' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.utils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updating existing volume attachment record: dffcf023-b78b-4d8b-b9d0-f5d1718ba994 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwMuKBIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:49:06 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:49:06 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:49:06 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa205d5-20b1-4390-89e5-35a37e30a185]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:49:06 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk 1073741824" returned: 0 in 0.065s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[035a76a0-1635-4589-89f8-8109bb101f63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae] added
Apr 13 21:49:06 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.052s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[159f8f1b-3802-4df2-8594-4cb658378956]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cfb971-c368-4fdb-916d-fce856f4dfd5]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwMuKBIj {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwMuKBIj" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb519cf3-7acf-49b7-bc78-718d38f9093a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PwMuKBIj'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fd4e73-b785-4c9f-84c9-7dd4397fc874]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe1cb46-2fad-437b-9d9a-7529e1a0eeec]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:06 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:06 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.network.neutron [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Successfully created port: 922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e224ba7e-77b0-499c-a6f5-3243ed26af2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260]
Apr 13 21:49:06 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260] successful.
Apr 13 21:49:06 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Cannot resize image /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.objects.instance [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'migration_context' on Instance uuid b5ce77dc-eda4-4b96-8d61-2297d986f3ee {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Ensure instance console log exists: /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b50e8ce-1ce1-4017-abbf-b984760f53ce]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[296a7d30-bf87-44de-8a7d-304fb2c13b8d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:06 user nova-compute[71325]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:49:06 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:06 user nova-compute[71325]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:49:06 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.440s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8394b6b-b559-471f-bf61-51a1fe70fc4f]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:06 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422532.0904305, ff61d99e-4db9-421f-8c01-264a7278c095 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:49:07 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] VM Stopped (Lifecycle Event)
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-783fd9a0-db3c-4097-96bb-9f65dab38283 None None] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Updating instance_info_cache with network_info: [{"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.network.neutron [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Successfully updated port: 922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquired lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.network.neutron [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.compute.manager [req-07829766-005e-4943-aa3e-77952eceeda7 req-a7bd5802-b2be-4e27-9091-0f99e1379011 service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Received event network-changed-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.compute.manager [req-07829766-005e-4943-aa3e-77952eceeda7 req-a7bd5802-b2be-4e27-9091-0f99e1379011 service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Refreshing instance network info cache due to event network-changed-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-07829766-005e-4943-aa3e-77952eceeda7 req-a7bd5802-b2be-4e27-9091-0f99e1379011 service nova] Acquiring lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.network.neutron [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwMuKBIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '23734383034383064', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734383034383064', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-140399517',display_name='tempest-AttachVolumeTestJSON-server-140399517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-140399517',id=3,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtoB3nR0JKHa6Ky1vXPwyI7w+rB3Ypa07sW6QVuaj3CXiFeuqRSmd55pQSr/lvFo9l5efcEiAn2oFJFeJlQXi0+ollyvkUFol9Z6nrTwTO2rVl/RiddJVHfv6WKf61UrQ==',key_name='tempest-keypair-789187285',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3605d609b52b431993bcea0798a77554',ramdisk_id='',reservation_id='r-gimed3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-249879422',owner_user_name='tempest-AttachVolumeTestJSON-249879422-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60e4dadf9d9e41e6a91ee03a0cd50dc3',uuid=ddc7aa71-95a1-4a3c-a5c1-746b86a011c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converting VIF {"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'pci_devices' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:49:07 user nova-compute[71325]:   <uuid>ddc7aa71-95a1-4a3c-a5c1-746b86a011c2</uuid>
Apr 13 21:49:07 user nova-compute[71325]:   <name>instance-00000003</name>
Apr 13 21:49:07 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:49:07 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:49:07 user nova-compute[71325]:   <metadata>
Apr 13 21:49:07 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:49:07 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:49:07 user nova-compute[71325]:       <nova:name>tempest-AttachVolumeTestJSON-server-140399517</nova:name>
Apr 13 21:49:07 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:49:06</nova:creationTime>
Apr 13 21:49:07 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:49:07 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:49:07 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:49:07 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:49:07 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:49:07 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:49:07 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:49:07 user nova-compute[71325]:       <nova:owner>
Apr 13 21:49:07 user nova-compute[71325]:         <nova:user uuid="60e4dadf9d9e41e6a91ee03a0cd50dc3">tempest-AttachVolumeTestJSON-249879422-project-member</nova:user>
Apr 13 21:49:07 user nova-compute[71325]:         <nova:project uuid="3605d609b52b431993bcea0798a77554">tempest-AttachVolumeTestJSON-249879422</nova:project>
Apr 13 21:49:07 user nova-compute[71325]:       </nova:owner>
Apr 13 21:49:07 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:49:07 user nova-compute[71325]:       <nova:ports>
Apr 13 21:49:07 user nova-compute[71325]:         <nova:port uuid="a70898ac-83fd-4f25-be37-aef7c87f6059">
Apr 13 21:49:07 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 21:49:07 user nova-compute[71325]:         </nova:port>
Apr 13 21:49:07 user nova-compute[71325]:       </nova:ports>
Apr 13 21:49:07 user nova-compute[71325]:     </nova:instance>
Apr 13 21:49:07 user nova-compute[71325]:   </metadata>
Apr 13 21:49:07 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:49:07 user nova-compute[71325]:     <system>
Apr 13 21:49:07 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:49:07 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:49:07 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:49:07 user nova-compute[71325]:       <entry name="serial">ddc7aa71-95a1-4a3c-a5c1-746b86a011c2</entry>
Apr 13 21:49:07 user nova-compute[71325]:       <entry name="uuid">ddc7aa71-95a1-4a3c-a5c1-746b86a011c2</entry>
Apr 13 21:49:07 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:49:07 user nova-compute[71325]:     </system>
Apr 13 21:49:07 user nova-compute[71325]:   </sysinfo>
Apr 13 21:49:07 user nova-compute[71325]:   <os>
Apr 13 21:49:07 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:49:07 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:49:07 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:49:07 user nova-compute[71325]:   </os>
Apr 13 21:49:07 user nova-compute[71325]:   <features>
Apr 13 21:49:07 user nova-compute[71325]:     <acpi/>
Apr 13 21:49:07 user nova-compute[71325]:     <apic/>
Apr 13 21:49:07 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:49:07 user nova-compute[71325]:   </features>
Apr 13 21:49:07 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:49:07 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:49:07 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:49:07 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:49:07 user nova-compute[71325]:   </clock>
Apr 13 21:49:07 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:49:07 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:49:07 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:49:07 user nova-compute[71325]:   </cpu>
Apr 13 21:49:07 user nova-compute[71325]:   <devices>
Apr 13 21:49:07 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:49:07 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:49:07 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk"/>
Apr 13 21:49:07 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:49:07 user nova-compute[71325]:     </disk>
Apr 13 21:49:07 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:49:07 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:49:07 user nova-compute[71325]:       <source dev="/dev/sdb"/>
Apr 13 21:49:07 user nova-compute[71325]:       <target dev="vdb" bus="virtio"/>
Apr 13 21:49:07 user nova-compute[71325]:       <serial>5c84a9a6-d73f-46ba-b157-ba2642a6a5ae</serial>
Apr 13 21:49:07 user nova-compute[71325]:     </disk>
Apr 13 21:49:07 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:49:07 user nova-compute[71325]:       <mac address="fa:16:3e:fd:52:e7"/>
Apr 13 21:49:07 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:49:07 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:49:07 user nova-compute[71325]:       <target dev="tapa70898ac-83"/>
Apr 13 21:49:07 user nova-compute[71325]:     </interface>
Apr 13 21:49:07 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:49:07 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/console.log" append="off"/>
Apr 13 21:49:07 user nova-compute[71325]:     </serial>
Apr 13 21:49:07 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:49:07 user nova-compute[71325]:     <video>
Apr 13 21:49:07 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:49:07 user nova-compute[71325]:     </video>
Apr 13 21:49:07 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:49:07 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:49:07 user nova-compute[71325]:     </rng>
Apr 13 21:49:07 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:49:07 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:49:07 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:49:07 user nova-compute[71325]:     </memballoon>
Apr 13 21:49:07 user nova-compute[71325]:   </devices>
Apr 13 21:49:07 user nova-compute[71325]: </domain>
Apr 13 21:49:07 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.network.neutron [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Updating instance_info_cache with network_info: [{"id": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "address": "fa:16:3e:c3:11:10", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922fdd9d-6e", "ovs_interfaceid": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'trusted_certs' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Releasing lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Instance network_info: |[{"id": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "address": "fa:16:3e:c3:11:10", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922fdd9d-6e", "ovs_interfaceid": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-07829766-005e-4943-aa3e-77952eceeda7 req-a7bd5802-b2be-4e27-9091-0f99e1379011 service nova] Acquired lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.network.neutron [req-07829766-005e-4943-aa3e-77952eceeda7 req-a7bd5802-b2be-4e27-9091-0f99e1379011 service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Refreshing network info cache for port 922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Start _get_guest_xml network_info=[{"id": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "address": "fa:16:3e:c3:11:10", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922fdd9d-6e", "ovs_interfaceid": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:08 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:49:08 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:49:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1503190655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1503190655',id=16,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11a30fba887e4114be856d26b47a8e55',ramdisk_id='',reservation_id='r-0ya09mva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-33854562',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:49:06Z,user_data=None,user_id='0ab740920cac4befac62a72f7ce5a817',uuid=b5ce77dc-eda4-4b96-8d61-2297d986f3ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "address": "fa:16:3e:c3:11:10", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922fdd9d-6e", "ovs_interfaceid": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converting VIF {"id": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "address": "fa:16:3e:c3:11:10", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922fdd9d-6e", "ovs_interfaceid": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:11:10,bridge_name='br-int',has_traffic_filtering=True,id=922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922fdd9d-6e') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.objects.instance [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'pci_devices' on Instance uuid b5ce77dc-eda4-4b96-8d61-2297d986f3ee {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:49:08 user nova-compute[71325]:   <uuid>b5ce77dc-eda4-4b96-8d61-2297d986f3ee</uuid>
Apr 13 21:49:08 user nova-compute[71325]:   <name>instance-00000010</name>
Apr 13 21:49:08 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:49:08 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:49:08 user nova-compute[71325]:   <metadata>
Apr 13 21:49:08 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:49:08 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:49:08 user nova-compute[71325]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1503190655</nova:name>
Apr 13 21:49:08 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:49:08</nova:creationTime>
Apr 13 21:49:08 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:49:08 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:49:08 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:49:08 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:49:08 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:49:08 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:49:08 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:49:08 user nova-compute[71325]:       <nova:owner>
Apr 13 21:49:08 user nova-compute[71325]:         <nova:user uuid="0ab740920cac4befac62a72f7ce5a817">tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member</nova:user>
Apr 13 21:49:08 user nova-compute[71325]:         <nova:project uuid="11a30fba887e4114be856d26b47a8e55">tempest-ServerBootFromVolumeStableRescueTest-33854562</nova:project>
Apr 13 21:49:08 user nova-compute[71325]:       </nova:owner>
Apr 13 21:49:08 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:49:08 user nova-compute[71325]:       <nova:ports>
Apr 13 21:49:08 user nova-compute[71325]:         <nova:port uuid="922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec">
Apr 13 21:49:08 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 21:49:08 user nova-compute[71325]:         </nova:port>
Apr 13 21:49:08 user nova-compute[71325]:       </nova:ports>
Apr 13 21:49:08 user nova-compute[71325]:     </nova:instance>
Apr 13 21:49:08 user nova-compute[71325]:   </metadata>
Apr 13 21:49:08 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:49:08 user nova-compute[71325]:     <system>
Apr 13 21:49:08 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:49:08 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:49:08 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:49:08 user nova-compute[71325]:       <entry name="serial">b5ce77dc-eda4-4b96-8d61-2297d986f3ee</entry>
Apr 13 21:49:08 user nova-compute[71325]:       <entry name="uuid">b5ce77dc-eda4-4b96-8d61-2297d986f3ee</entry>
Apr 13 21:49:08 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:49:08 user nova-compute[71325]:     </system>
Apr 13 21:49:08 user nova-compute[71325]:   </sysinfo>
Apr 13 21:49:08 user nova-compute[71325]:   <os>
Apr 13 21:49:08 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:49:08 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:49:08 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:49:08 user nova-compute[71325]:   </os>
Apr 13 21:49:08 user nova-compute[71325]:   <features>
Apr 13 21:49:08 user nova-compute[71325]:     <acpi/>
Apr 13 21:49:08 user nova-compute[71325]:     <apic/>
Apr 13 21:49:08 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:49:08 user nova-compute[71325]:   </features>
Apr 13 21:49:08 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:49:08 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:49:08 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:49:08 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:49:08 user nova-compute[71325]:   </clock>
Apr 13 21:49:08 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:49:08 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:49:08 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:49:08 user nova-compute[71325]:   </cpu>
Apr 13 21:49:08 user nova-compute[71325]:   <devices>
Apr 13 21:49:08 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:49:08 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:49:08 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk"/>
Apr 13 21:49:08 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:49:08 user nova-compute[71325]:     </disk>
Apr 13 21:49:08 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:49:08 user nova-compute[71325]:       <mac address="fa:16:3e:c3:11:10"/>
Apr 13 21:49:08 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:49:08 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:49:08 user nova-compute[71325]:       <target dev="tap922fdd9d-6e"/>
Apr 13 21:49:08 user nova-compute[71325]:     </interface>
Apr 13 21:49:08 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:49:08 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/console.log" append="off"/>
Apr 13 21:49:08 user nova-compute[71325]:     </serial>
Apr 13 21:49:08 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:49:08 user nova-compute[71325]:     <video>
Apr 13 21:49:08 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:49:08 user nova-compute[71325]:     </video>
Apr 13 21:49:08 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:49:08 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:49:08 user nova-compute[71325]:     </rng>
Apr 13 21:49:08 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:49:08 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:49:08 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:49:08 user nova-compute[71325]:     </memballoon>
Apr 13 21:49:08 user nova-compute[71325]:   </devices>
Apr 13 21:49:08 user nova-compute[71325]: </domain>
Apr 13 21:49:08 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:49:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1503190655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1503190655',id=16,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11a30fba887e4114be856d26b47a8e55',ramdisk_id='',reservation_id='r-0ya09mva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-33854562',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:49:06Z,user_data=None,user_id='0ab740920cac4befac62a72f7ce5a817',uuid=b5ce77dc-eda4-4b96-8d61-2297d986f3ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "address": "fa:16:3e:c3:11:10", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922fdd9d-6e", "ovs_interfaceid": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converting VIF {"id": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "address": "fa:16:3e:c3:11:10", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922fdd9d-6e", "ovs_interfaceid": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:11:10,bridge_name='br-int',has_traffic_filtering=True,id=922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922fdd9d-6e') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG os_vif [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:11:10,bridge_name='br-int',has_traffic_filtering=True,id=922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922fdd9d-6e') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap922fdd9d-6e, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap922fdd9d-6e, col_values=(('external_ids', {'iface-id': '922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:11:10', 'vm-uuid': 'b5ce77dc-eda4-4b96-8d61-2297d986f3ee'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:08 user nova-compute[71325]: INFO os_vif [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:11:10,bridge_name='br-int',has_traffic_filtering=True,id=922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922fdd9d-6e')
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] No VIF found with MAC fa:16:3e:c3:11:10, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Cannot resize image /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'migration_context' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-140399517',display_name='tempest-AttachVolumeTestJSON-server-140399517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-140399517',id=3,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtoB3nR0JKHa6Ky1vXPwyI7w+rB3Ypa07sW6QVuaj3CXiFeuqRSmd55pQSr/lvFo9l5efcEiAn2oFJFeJlQXi0+ollyvkUFol9Z6nrTwTO2rVl/RiddJVHfv6WKf61UrQ==',key_name='tempest-keypair-789187285',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3605d609b52b431993bcea0798a77554',ramdisk_id='',reservation_id='r-gimed3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-249879422',owner_user_name='tempest-AttachVolumeTestJSON-249879422-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60e4dadf9d9e41e6a91ee03a0cd50dc3',uuid=ddc7aa71-95a1-4a3c-a5c1-746b86a011c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converting VIF {"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG os_vif [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa70898ac-83, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa70898ac-83, col_values=(('external_ids', {'iface-id': 'a70898ac-83fd-4f25-be37-aef7c87f6059', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:52:e7', 'vm-uuid': 'ddc7aa71-95a1-4a3c-a5c1-746b86a011c2'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:08 user nova-compute[71325]: INFO os_vif [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83')
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.network.neutron [req-07829766-005e-4943-aa3e-77952eceeda7 req-a7bd5802-b2be-4e27-9091-0f99e1379011 service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Updated VIF entry in instance network info cache for port 922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG nova.network.neutron [req-07829766-005e-4943-aa3e-77952eceeda7 req-a7bd5802-b2be-4e27-9091-0f99e1379011 service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Updating instance_info_cache with network_info: [{"id": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "address": "fa:16:3e:c3:11:10", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922fdd9d-6e", "ovs_interfaceid": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:49:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-07829766-005e-4943-aa3e-77952eceeda7 req-a7bd5802-b2be-4e27-9091-0f99e1379011 service nova] Releasing lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:49:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG nova.objects.instance [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'pci_requests' on Instance uuid eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG nova.objects.instance [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'numa_topology' on Instance uuid eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:49:10 user nova-compute[71325]: INFO nova.compute.claims [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Claim successful on node user
Apr 13 21:49:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YofKpNRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:49:10 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:49:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:49:10 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:49:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:49:10 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:49:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d28220-5f41-4846-84da-dac6201fbebf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:49:10 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9209bb-d6eb-458e-bebe-df315da6f05b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b] added
Apr 13 21:49:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ad7168-a4cf-4c43-ab55-6aca60bc90da]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4982594-2a96-4e12-b1da-37c84367653d]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YofKpNRZ {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YofKpNRZ" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4688034a-3618-45f7-b48d-70feb5f28116]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YofKpNRZ'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[19898f82-f185-4618-8b96-50b3f6244c84]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51665b6-0166-4b39-8acd-43994694c745]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:11 user nova-compute[71325]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:49:11 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:11 user nova-compute[71325]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:49:11 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG nova.compute.manager [req-37468e07-a1de-479d-9703-81491cb5032c req-39ce5496-4d79-47fa-854d-6daa228f61fc service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Received event network-vif-plugged-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-37468e07-a1de-479d-9703-81491cb5032c req-39ce5496-4d79-47fa-854d-6daa228f61fc service nova] Acquiring lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-37468e07-a1de-479d-9703-81491cb5032c req-39ce5496-4d79-47fa-854d-6daa228f61fc service nova] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-37468e07-a1de-479d-9703-81491cb5032c req-39ce5496-4d79-47fa-854d-6daa228f61fc service nova] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG nova.compute.manager [req-37468e07-a1de-479d-9703-81491cb5032c req-39ce5496-4d79-47fa-854d-6daa228f61fc service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] No waiting events found dispatching network-vif-plugged-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:11 user nova-compute[71325]: WARNING nova.compute.manager [req-37468e07-a1de-479d-9703-81491cb5032c req-39ce5496-4d79-47fa-854d-6daa228f61fc service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Received unexpected event network-vif-plugged-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec for instance with vm_state building and task_state spawning.
Apr 13 21:49:11 user nova-compute[71325]: INFO nova.network.neutron [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updating port e918ab8f-9fcd-47df-974d-eb6568414011 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f25000e-5015-4c83-8c76-f89cd9e8f694]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b, portal: 172.16.0.220,3260]
Apr 13 21:49:11 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b, portal: 172.16.0.220,3260] successful.
Apr 13 21:49:11 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d434f67-1586-40a6-8406-60e0a4992534]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e798e23b-b104-4a94-abb9-80935313702a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:11 user nova-compute[71325]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:49:11 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:49:11 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:11 user nova-compute[71325]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:49:11 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:49:11 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[310b70bc-3f31-440a-a926-0751b0b9aaa4]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YofKpNRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG nova.compute.manager [req-123098cd-807d-4340-8284-c3a018c20ecf req-35492a77-9077-487f-b315-3a18b263fe6d service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-123098cd-807d-4340-8284-c3a018c20ecf req-35492a77-9077-487f-b315-3a18b263fe6d service nova] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-123098cd-807d-4340-8284-c3a018c20ecf req-35492a77-9077-487f-b315-3a18b263fe6d service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-123098cd-807d-4340-8284-c3a018c20ecf req-35492a77-9077-487f-b315-3a18b263fe6d service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:11 user nova-compute[71325]: DEBUG nova.compute.manager [req-123098cd-807d-4340-8284-c3a018c20ecf req-35492a77-9077-487f-b315-3a18b263fe6d service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] No waiting events found dispatching network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:11 user nova-compute[71325]: WARNING nova.compute.manager [req-123098cd-807d-4340-8284-c3a018c20ecf req-35492a77-9077-487f-b315-3a18b263fe6d service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received unexpected event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 for instance with vm_state stopped and task_state powering-on.
Apr 13 21:49:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:49:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23232643338623965', 'path': '/dev/sdd'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:49:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232643338623965', 'path': '/dev/sdd'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:49:12 user nova-compute[71325]: DEBUG nova.objects.instance [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'flavor' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:49:12 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:49:12 user nova-compute[71325]:   <source dev="/dev/sdd"/>
Apr 13 21:49:12 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:49:12 user nova-compute[71325]:   <serial>5b928772-e4f8-489b-93b3-282f3c7c184b</serial>
Apr 13 21:49:12 user nova-compute[71325]: </disk>
Apr 13 21:49:12 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:49:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:49:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquired lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:49:12 user nova-compute[71325]: DEBUG nova.network.neutron [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:49:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:49:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:49:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] No VIF found with MAC fa:16:3e:f2:21:5b, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.network.neutron [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updating instance_info_cache with network_info: [{"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.122s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Releasing lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:49:13 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Creating image(s)
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "/opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "/opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "/opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.objects.instance [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'trusted_certs' on Instance uuid eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "0bf36e5090d0b5b4c84f9c845fa8729002aa83b2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "0bf36e5090d0b5b4c84f9c845fa8729002aa83b2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.compute.manager [req-82a43cb3-a910-4189-a0e4-5de42c4be9c4 req-fb9f262f-19b1-4655-a847-cf9f55ed09a8 service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Received event network-vif-plugged-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-82a43cb3-a910-4189-a0e4-5de42c4be9c4 req-fb9f262f-19b1-4655-a847-cf9f55ed09a8 service nova] Acquiring lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-82a43cb3-a910-4189-a0e4-5de42c4be9c4 req-fb9f262f-19b1-4655-a847-cf9f55ed09a8 service nova] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-82a43cb3-a910-4189-a0e4-5de42c4be9c4 req-fb9f262f-19b1-4655-a847-cf9f55ed09a8 service nova] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.compute.manager [req-82a43cb3-a910-4189-a0e4-5de42c4be9c4 req-fb9f262f-19b1-4655-a847-cf9f55ed09a8 service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] No waiting events found dispatching network-vif-plugged-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:13 user nova-compute[71325]: WARNING nova.compute.manager [req-82a43cb3-a910-4189-a0e4-5de42c4be9c4 req-fb9f262f-19b1-4655-a847-cf9f55ed09a8 service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Received unexpected event network-vif-plugged-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec for instance with vm_state building and task_state spawning.
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2.part --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422553.750148, ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:49:13 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] VM Resumed (Lifecycle Event)
Apr 13 21:49:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.compute.manager [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.compute.manager [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] No waiting events found dispatching network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:13 user nova-compute[71325]: WARNING nova.compute.manager [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received unexpected event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 for instance with vm_state stopped and task_state powering-on.
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.compute.manager [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-changed-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.compute.manager [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Refreshing instance network info cache due to event network-changed-e918ab8f-9fcd-47df-974d-eb6568414011. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] Acquiring lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] Acquired lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.network.neutron [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Refreshing network info cache for port e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:13 user nova-compute[71325]: INFO nova.compute.manager [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Rescuing
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquired lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.network.neutron [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:49:13 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Instance rebooted successfully.
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:13 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Instance spawned successfully.
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2.part --force-share --output=json" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.virt.images [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 53583ecc-7b0f-4a49-9837-b60d794a3cfc was qcow2, converting to raw {{(pid=71325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:49:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2.part /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2.converted {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:14 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422553.7505634, ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:49:14 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] VM Started (Lifecycle Event)
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422553.8065963, b5ce77dc-eda4-4b96-8d61-2297d986f3ee => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:49:14 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] VM Resumed (Lifecycle Event)
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2.part /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2.converted" returned: 0 in 0.262s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2.converted --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:49:14 user nova-compute[71325]: INFO nova.compute.manager [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Took 8.43 seconds to spawn the instance on the hypervisor.
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:14 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422553.8075395, b5ce77dc-eda4-4b96-8d61-2297d986f3ee => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:49:14 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] VM Started (Lifecycle Event)
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:49:14 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2.converted --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "0bf36e5090d0b5b4c84f9c845fa8729002aa83b2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.356s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:14 user nova-compute[71325]: INFO nova.compute.manager [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Took 9.77 seconds to build instance.
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.895s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2 --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "0bf36e5090d0b5b4c84f9c845fa8729002aa83b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "0bf36e5090d0b5b4c84f9c845fa8729002aa83b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2 --force-share --output=json" returned: 0 in 0.163s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2,backing_fmt=raw /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2,backing_fmt=raw /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk 1073741824" returned: 0 in 0.056s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "0bf36e5090d0b5b4c84f9c845fa8729002aa83b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2 --force-share --output=json" returned: 0 in 0.164s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:14 user nova-compute[71325]: DEBUG nova.objects.instance [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'migration_context' on Instance uuid eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:14 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Rebasing disk image.
Apr 13 21:49:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updating instance_info_cache with network_info: [{"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG nova.network.neutron [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updated VIF entry in instance network info cache for port e918ab8f-9fcd-47df-974d-eb6568414011. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG nova.network.neutron [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updating instance_info_cache with network_info: [{"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Releasing lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] Releasing lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.155s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 -F raw /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422540.3129056, 35820c1d-307d-43ed-b3d1-31fe12602870 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:49:15 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] VM Stopped (Lifecycle Event)
Apr 13 21:49:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-63299d0f-e442-49d3-8c5b-df09de65cb25 None None] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-d5ba495a-eeb7-4a26-9b8b-66b835c0145a req-1ddab3b0-dbb0-4a72-b6b8-2a60499945d7 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-vif-unplugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d5ba495a-eeb7-4a26-9b8b-66b835c0145a req-1ddab3b0-dbb0-4a72-b6b8-2a60499945d7 service nova] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d5ba495a-eeb7-4a26-9b8b-66b835c0145a req-1ddab3b0-dbb0-4a72-b6b8-2a60499945d7 service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d5ba495a-eeb7-4a26-9b8b-66b835c0145a req-1ddab3b0-dbb0-4a72-b6b8-2a60499945d7 service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-d5ba495a-eeb7-4a26-9b8b-66b835c0145a req-1ddab3b0-dbb0-4a72-b6b8-2a60499945d7 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] No waiting events found dispatching network-vif-unplugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:15 user nova-compute[71325]: WARNING nova.compute.manager [req-d5ba495a-eeb7-4a26-9b8b-66b835c0145a req-1ddab3b0-dbb0-4a72-b6b8-2a60499945d7 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received unexpected event network-vif-unplugged-f0a7bc69-be17-49d2-94fc-40541afce8ed for instance with vm_state active and task_state rescuing.
Apr 13 21:49:16 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Instance destroyed successfully.
Apr 13 21:49:16 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Attempting a stable device rescue
Apr 13 21:49:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71325) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 21:49:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Instance directory exists: not creating {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 21:49:16 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Creating image(s)
Apr 13 21:49:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "/opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "/opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "/opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:16 user nova-compute[71325]: DEBUG nova.objects.instance [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'trusted_certs' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "5d3b13bb467c442361a397f43643c914b2431816" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "5d3b13bb467c442361a397f43643c914b2431816" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816.part --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816.part --force-share --output=json" returned: 0 in 0.207s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.images [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 681d671a-5206-4f33-9bd7-d9abc8678d02 was qcow2, converting to raw {{(pid=71325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816.part /opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816.converted {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 -F raw /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk" returned: 0 in 2.469s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Ensure instance console log exists: /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Start _get_guest_xml network_info=[{"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b6792026dcb5a0ebba54d5b6569f3ae7',container_format='bare',created_at=2023-04-13T21:47:13Z,direct_url=<?>,disk_format='qcow2',id=53583ecc-7b0f-4a49-9837-b60d794a3cfc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1025681919-shelved',owner='73c23bc3e8b14441b4622095502b5dae',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T21:47:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHBbsGPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'eaff33f4-c1f5-45c5-b54f-555d1c66e8c7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a325d973-036d-409b-af0a-cae00a2d5474', 'serial': 'a325d973-036d-409b-af0a-cae00a2d5474'}, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '05b8afc4-ca5e-4d02-8b2f-b6f976ea465d', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816.part /opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816.converted" returned: 0 in 0.155s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816.converted --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:17 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:49:17 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b6792026dcb5a0ebba54d5b6569f3ae7',container_format='bare',created_at=2023-04-13T21:47:13Z,direct_url=<?>,disk_format='qcow2',id=53583ecc-7b0f-4a49-9837-b60d794a3cfc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1025681919-shelved',owner='73c23bc3e8b14441b4622095502b5dae',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T21:47:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.objects.instance [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'vcpu_model' on Instance uuid eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-51072e53-adb3-4c5a-baa9-856c6436e5e8 req-80b6ce95-111f-450a-838f-880a215931cf service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-51072e53-adb3-4c5a-baa9-856c6436e5e8 req-80b6ce95-111f-450a-838f-880a215931cf service nova] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-51072e53-adb3-4c5a-baa9-856c6436e5e8 req-80b6ce95-111f-450a-838f-880a215931cf service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-51072e53-adb3-4c5a-baa9-856c6436e5e8 req-80b6ce95-111f-450a-838f-880a215931cf service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-51072e53-adb3-4c5a-baa9-856c6436e5e8 req-80b6ce95-111f-450a-838f-880a215931cf service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] No waiting events found dispatching network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:17 user nova-compute[71325]: WARNING nova.compute.manager [req-51072e53-adb3-4c5a-baa9-856c6436e5e8 req-80b6ce95-111f-450a-838f-880a215931cf service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received unexpected event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed for instance with vm_state active and task_state rescuing.
Apr 13 21:49:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHBbsGPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:49:17 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:49:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:49:17 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:49:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:49:17 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd990e40-71f5-4c15-8859-bc20393d1427]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:49:17 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "5d3b13bb467c442361a397f43643c914b2431816" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.692s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "5d3b13bb467c442361a397f43643c914b2431816" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "5d3b13bb467c442361a397f43643c914b2431816" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4752d181-c5aa-4cff-96ee-c76596965f8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474] added
Apr 13 21:49:17 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9bba36-b64d-43e0-a98c-ff945e92726b]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcf67bf-63db-4993-abb7-00ba5488520f]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VHBbsGPr {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VHBbsGPr" returned: 0 in 0.031s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3c373c-8496-4cb8-bcb5-6f5f48a0bff4]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VHBbsGPr'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cc2497-f4ee-4554-946c-357eda225440]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816 --force-share --output=json" returned: 0 in 0.160s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816,backing_fmt=raw /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.rescue {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c211296-8cf0-4f0f-a47d-12cbe9368993]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:18 user nova-compute[71325]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:49:18 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:49:18 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:18 user nova-compute[71325]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:49:18 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:49:18 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816,backing_fmt=raw /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.rescue" returned: 0 in 0.060s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "5d3b13bb467c442361a397f43643c914b2431816" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.objects.instance [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'migration_context' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Start _get_guest_xml network_info=[{"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "vif_mac": "fa:16:3e:f2:21:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '681d671a-5206-4f33-9bd7-d9abc8678d02', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YofKpNRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'af4efbd5-a4c1-4e7c-b274-92413f86f2a8', 'attached_at': '', 'detached_at': '', 'volume_id': '5b928772-e4f8-489b-93b3-282f3c7c184b', 'serial': '5b928772-e4f8-489b-93b3-282f3c7c184b'}, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'dffcf023-b78b-4d8b-b9d0-f5d1718ba994', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.objects.instance [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'resources' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.objects.instance [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'numa_topology' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9ad347-700e-4ecb-976e-fe9a163c2b4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474, portal: 172.16.0.220,3260]
Apr 13 21:49:18 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474, portal: 172.16.0.220,3260] successful.
Apr 13 21:49:18 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:18 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:49:18 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.objects.instance [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'vcpu_model' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c19956-6dad-4514-88b7-68295e838c2e]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YofKpNRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:49:18 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bad8b62-3e7b-4914-9a6c-abd9119fb102]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:18 user nova-compute[71325]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:49:18 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:49:18 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:49:18 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:18 user nova-compute[71325]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:49:18 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:49:18 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:49:18 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] HCTL ('36', '-', '-', 0) found on session 14 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[505506aa-a001-46f1-9731-6b6b52c286ec]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: None {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:49:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHBbsGPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '26364383731333537', 'path': '/dev/sde'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364383731333537', 'path': '/dev/sde'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.044s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:49:19 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:49:19 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99cd43d-3f7c-44d5-beb6-378a9b48fd40]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YofKpNRZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 21:49:19 user nova-compute[71325]: node.name = iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b
Apr 13 21:49:19 user nova-compute[71325]: node.tpgt = -1
Apr 13 21:49:19 user nova-compute[71325]: node.startup = automatic
Apr 13 21:49:19 user nova-compute[71325]: node.leading_login = No
Apr 13 21:49:19 user nova-compute[71325]: iface.iscsi_ifacename = default
Apr 13 21:49:19 user nova-compute[71325]: iface.net_ifacename = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.ipaddress = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.prefix_len = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.hwaddress = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.transport_name = tcp
Apr 13 21:49:19 user nova-compute[71325]: iface.initiatorname = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.state = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.vlan_id = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.vlan_priority = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.vlan_state = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.iface_num = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.mtu = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.port = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.bootproto = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.subnet_mask = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.gateway = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.dhcp_alt_client_id = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.dhcp_dns = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.dhcp_learn_iqn = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.dhcp_vendor_id_state = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.dhcp_vendor_id = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.dhcp_slp_da = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.fragmentation = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.gratuitous_arp = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.incoming_forwarding = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.tos_state = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.tos = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.ttl = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.delayed_ack = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.tcp_nagle = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.tcp_wsf_state = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.tcp_wsf = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.tcp_timer_scale = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.tcp_timestamp = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.redirect = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.def_task_mgmt_timeout = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.header_digest = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.data_digest = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.immediate_data = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.initial_r2t = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.data_seq_inorder = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.data_pdu_inorder = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.erl = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.max_receive_data_len = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.first_burst_len = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.max_outstanding_r2t = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.max_burst_len = 0
Apr 13 21:49:19 user nova-compute[71325]: iface.chap_auth = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.bidi_chap = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.strict_login_compliance = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.discovery_auth = <empty>
Apr 13 21:49:19 user nova-compute[71325]: iface.discovery_logout = <empty>
Apr 13 21:49:19 user nova-compute[71325]: node.discovery_address = <empty>
Apr 13 21:49:19 user nova-compute[71325]: node.discovery_port = 0
Apr 13 21:49:19 user nova-compute[71325]: node.discovery_type = static
Apr 13 21:49:19 user nova-compute[71325]: node.session.initial_cmdsn = 0
Apr 13 21:49:19 user nova-compute[71325]: node.session.initial_login_retry_max = 8
Apr 13 21:49:19 user nova-compute[71325]: node.session.xmit_thread_priority = -20
Apr 13 21:49:19 user nova-compute[71325]: node.session.cmds_max = 128
Apr 13 21:49:19 user nova-compute[71325]: node.session.queue_depth = 32
Apr 13 21:49:19 user nova-compute[71325]: node.session.nr_sessions = 1
Apr 13 21:49:19 user nova-compute[71325]: node.session.auth.authmethod = CHAP
Apr 13 21:49:19 user nova-compute[71325]: node.session.auth.username = YofKpNRZ
Apr 13 21:49:19 user nova-compute[71325]: node.session.auth.password = ***
Apr 13 21:49:19 user nova-compute[71325]: node.session.auth.username_in = <empty>
Apr 13 21:49:19 user nova-compute[71325]: node.session.auth.password_in = <empty>
Apr 13 21:49:19 user nova-compute[71325]: node.session.auth.chap_algs = MD5
Apr 13 21:49:19 user nova-compute[71325]: node.session.timeo.replacement_timeout = 120
Apr 13 21:49:19 user nova-compute[71325]: node.session.err_timeo.abort_timeout = 15
Apr 13 21:49:19 user nova-compute[71325]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 21:49:19 user nova-compute[71325]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 21:49:19 user nova-compute[71325]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 21:49:19 user nova-compute[71325]: node.session.iscsi.FastAbort = Yes
Apr 13 21:49:19 user nova-compute[71325]: node.session.iscsi.InitialR2T = No
Apr 13 21:49:19 user nova-compute[71325]: node.session.iscsi.ImmediateData = Yes
Apr 13 21:49:19 user nova-compute[71325]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 21:49:19 user nova-compute[71325]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 21:49:19 user nova-compute[71325]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 21:49:19 user nova-compute[71325]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 21:49:19 user nova-compute[71325]: node.session.iscsi.MaxConnections = 1
Apr 13 21:49:19 user nova-compute[71325]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 21:49:19 user nova-compute[71325]: node.session.iscsi.ERL = 0
Apr 13 21:49:19 user nova-compute[71325]: node.session.scan = manual
Apr 13 21:49:19 user nova-compute[71325]: node.session.reopen_max = 0
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].address = 172.16.0.220
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].port = 3260
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].startup = manual
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].tcp.window_size = 524288
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].tcp.type_of_service = 0
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].timeo.logout_timeout = 15
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].timeo.login_timeout = 15
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].timeo.auth_timeout = 45
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].iscsi.DataDigest = None
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].iscsi.IFMarker = No
Apr 13 21:49:19 user nova-compute[71325]: node.conn[0].iscsi.OFMarker = No
Apr 13 21:49:19 user nova-compute[71325]: # END RECORD
Apr 13 21:49:19 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1025681919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1025681919',id=6,image_ref='53583ecc-7b0f-4a49-9837-b60d794a3cfc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1819128718',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='73c23bc3e8b14441b4622095502b5dae',ramdisk_id='',reservation_id='r-m0kiebsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-710815470',owner_user_name='tempest-AttachVolumeShelveTestJSON-710815470-project-member',shelved_at='2023-04-13T21:47:17.645749',shelved_host='user',shelved_image_id='53583ecc-7b0f-4a49-9837-b60d794a3cfc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:49:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f151b673e3d47acb9c3ed9b9ecaf687',uuid=eaff33f4-c1f5-45c5-b54f-555d1c66e8c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converting VIF {"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:19:65,bridge_name='br-int',has_traffic_filtering=True,id=e918ab8f-9fcd-47df-974d-eb6568414011,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape918ab8f-9f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'pci_devices' on Instance uuid eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:49:19 user nova-compute[71325]:   <uuid>eaff33f4-c1f5-45c5-b54f-555d1c66e8c7</uuid>
Apr 13 21:49:19 user nova-compute[71325]:   <name>instance-00000006</name>
Apr 13 21:49:19 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:49:19 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:49:19 user nova-compute[71325]:   <metadata>
Apr 13 21:49:19 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:49:19 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:49:19 user nova-compute[71325]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1025681919</nova:name>
Apr 13 21:49:19 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:49:17</nova:creationTime>
Apr 13 21:49:19 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:49:19 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:49:19 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:49:19 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:49:19 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:49:19 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:49:19 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:49:19 user nova-compute[71325]:       <nova:owner>
Apr 13 21:49:19 user nova-compute[71325]:         <nova:user uuid="3f151b673e3d47acb9c3ed9b9ecaf687">tempest-AttachVolumeShelveTestJSON-710815470-project-member</nova:user>
Apr 13 21:49:19 user nova-compute[71325]:         <nova:project uuid="73c23bc3e8b14441b4622095502b5dae">tempest-AttachVolumeShelveTestJSON-710815470</nova:project>
Apr 13 21:49:19 user nova-compute[71325]:       </nova:owner>
Apr 13 21:49:19 user nova-compute[71325]:       <nova:root type="image" uuid="53583ecc-7b0f-4a49-9837-b60d794a3cfc"/>
Apr 13 21:49:19 user nova-compute[71325]:       <nova:ports>
Apr 13 21:49:19 user nova-compute[71325]:         <nova:port uuid="e918ab8f-9fcd-47df-974d-eb6568414011">
Apr 13 21:49:19 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 21:49:19 user nova-compute[71325]:         </nova:port>
Apr 13 21:49:19 user nova-compute[71325]:       </nova:ports>
Apr 13 21:49:19 user nova-compute[71325]:     </nova:instance>
Apr 13 21:49:19 user nova-compute[71325]:   </metadata>
Apr 13 21:49:19 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:49:19 user nova-compute[71325]:     <system>
Apr 13 21:49:19 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:49:19 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:49:19 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:49:19 user nova-compute[71325]:       <entry name="serial">eaff33f4-c1f5-45c5-b54f-555d1c66e8c7</entry>
Apr 13 21:49:19 user nova-compute[71325]:       <entry name="uuid">eaff33f4-c1f5-45c5-b54f-555d1c66e8c7</entry>
Apr 13 21:49:19 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:49:19 user nova-compute[71325]:     </system>
Apr 13 21:49:19 user nova-compute[71325]:   </sysinfo>
Apr 13 21:49:19 user nova-compute[71325]:   <os>
Apr 13 21:49:19 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:49:19 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:49:19 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:49:19 user nova-compute[71325]:   </os>
Apr 13 21:49:19 user nova-compute[71325]:   <features>
Apr 13 21:49:19 user nova-compute[71325]:     <acpi/>
Apr 13 21:49:19 user nova-compute[71325]:     <apic/>
Apr 13 21:49:19 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:49:19 user nova-compute[71325]:   </features>
Apr 13 21:49:19 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:49:19 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:49:19 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:49:19 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:49:19 user nova-compute[71325]:   </clock>
Apr 13 21:49:19 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:49:19 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:49:19 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:49:19 user nova-compute[71325]:   </cpu>
Apr 13 21:49:19 user nova-compute[71325]:   <devices>
Apr 13 21:49:19 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:49:19 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:49:19 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk"/>
Apr 13 21:49:19 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:49:19 user nova-compute[71325]:     </disk>
Apr 13 21:49:19 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:49:19 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:49:19 user nova-compute[71325]:       <source dev="/dev/sde"/>
Apr 13 21:49:19 user nova-compute[71325]:       <target dev="vdc" bus="virtio"/>
Apr 13 21:49:19 user nova-compute[71325]:       <serial>a325d973-036d-409b-af0a-cae00a2d5474</serial>
Apr 13 21:49:19 user nova-compute[71325]:     </disk>
Apr 13 21:49:19 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:49:19 user nova-compute[71325]:       <mac address="fa:16:3e:7c:19:65"/>
Apr 13 21:49:19 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:49:19 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:49:19 user nova-compute[71325]:       <target dev="tape918ab8f-9f"/>
Apr 13 21:49:19 user nova-compute[71325]:     </interface>
Apr 13 21:49:19 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:49:19 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/console.log" append="off"/>
Apr 13 21:49:19 user nova-compute[71325]:     </serial>
Apr 13 21:49:19 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:49:19 user nova-compute[71325]:     <video>
Apr 13 21:49:19 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:49:19 user nova-compute[71325]:     </video>
Apr 13 21:49:19 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:49:19 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:49:19 user nova-compute[71325]:     </rng>
Apr 13 21:49:19 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:49:19 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:49:19 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:49:19 user nova-compute[71325]:     </memballoon>
Apr 13 21:49:19 user nova-compute[71325]:   </devices>
Apr 13 21:49:19 user nova-compute[71325]: </domain>
Apr 13 21:49:19 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1025681919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1025681919',id=6,image_ref='53583ecc-7b0f-4a49-9837-b60d794a3cfc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1819128718',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='73c23bc3e8b14441b4622095502b5dae',ramdisk_id='',reservation_id='r-m0kiebsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-710815470',owner_user_name='tempest-AttachVolumeShelveTestJSON-710815470-project-member',shelved_at='2023-04-13T21:47:17.645749',shelved_host='user',shelved_image_id='53583ecc-7b0f-4a49-9837-b60d794a3cfc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:49:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f151b673e3d47acb9c3ed9b9ecaf687',uuid=eaff33f4-c1f5-45c5-b54f-555d1c66e8c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converting VIF {"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:19:65,bridge_name='br-int',has_traffic_filtering=True,id=e918ab8f-9fcd-47df-974d-eb6568414011,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape918ab8f-9f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_vif [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:19:65,bridge_name='br-int',has_traffic_filtering=True,id=e918ab8f-9fcd-47df-974d-eb6568414011,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape918ab8f-9f') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73ddb35-72c1-46bf-9f7d-e2393fc7d7eb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape918ab8f-9f, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape918ab8f-9f, col_values=(('external_ids', {'iface-id': 'e918ab8f-9fcd-47df-974d-eb6568414011', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:19:65', 'vm-uuid': 'eaff33f4-c1f5-45c5-b54f-555d1c66e8c7'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2caff4-a0d5-49f9-9479-33a23be703a1]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YofKpNRZ {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:19 user nova-compute[71325]: INFO os_vif [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:19:65,bridge_name='br-int',has_traffic_filtering=True,id=e918ab8f-9fcd-47df-974d-eb6568414011,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape918ab8f-9f')
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YofKpNRZ" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0781304e-387e-4d2a-b508-67eeff04f1f4]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YofKpNRZ'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] No VIF found with MAC fa:16:3e:7c:19:65, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.132s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1da9b69-764b-4fa4-bd70-fa4b069395f0]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b9f6f2-4785-4a39-a496-a686f78257db]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:19 user nova-compute[71325]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:49:19 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:49:19 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:49:19 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:49:19 user nova-compute[71325]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:49:19 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:49:19 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:49:19 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] HCTL ('35', '0', '0', 0) found on session 13 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.052s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9405ec85-788c-4c6f-a9b4-7c0276d3825e]: (4, ('0 0 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Searching for a device in session 13 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YofKpNRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.359s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23232643338623965', 'path': '/dev/sdd'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232643338623965', 'path': '/dev/sdd'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1586666894',display_name='tempest-ServerStableDeviceRescueTest-server-1586666894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1586666894',id=7,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEyy8lvN5JxTozYg9ByYCQUUKEcNGunFuCkWcpXFzcQgw9m/DW6nJHXR8e8LkSDM7KZy5/LgblZ7q8T1OTnPbj9wKvTJ0iV6fPco0NWPjXLrW2GtaHDcybWSGRNToUsWA==',key_name='tempest-keypair-1172830782',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4235a17cc95422dacb6386d4952fc8e',ramdisk_id='',reservation_id='r-z7lko0o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1552707388',owner_user_name='tempest-ServerStableDeviceRescueTest-1552707388-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:47:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c1bbf573ea436293abf4debdecc515',uuid=af4efbd5-a4c1-4e7c-b274-92413f86f2a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "vif_mac": "fa:16:3e:f2:21:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Converting VIF {"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "vif_mac": "fa:16:3e:f2:21:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=f0a7bc69-be17-49d2-94fc-40541afce8ed,network=Network(7401a99a-44e9-442d-8f64-8591e14e8388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a7bc69-be') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'pci_devices' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:49:19 user nova-compute[71325]:   <uuid>af4efbd5-a4c1-4e7c-b274-92413f86f2a8</uuid>
Apr 13 21:49:19 user nova-compute[71325]:   <name>instance-00000007</name>
Apr 13 21:49:19 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:49:19 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:49:19 user nova-compute[71325]:   <metadata>
Apr 13 21:49:19 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:49:19 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:49:19 user nova-compute[71325]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1586666894</nova:name>
Apr 13 21:49:19 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:49:18</nova:creationTime>
Apr 13 21:49:19 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:49:19 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:49:19 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:49:19 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:49:19 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:49:19 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:49:19 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:49:19 user nova-compute[71325]:       <nova:owner>
Apr 13 21:49:19 user nova-compute[71325]:         <nova:user uuid="c3c1bbf573ea436293abf4debdecc515">tempest-ServerStableDeviceRescueTest-1552707388-project-member</nova:user>
Apr 13 21:49:19 user nova-compute[71325]:         <nova:project uuid="d4235a17cc95422dacb6386d4952fc8e">tempest-ServerStableDeviceRescueTest-1552707388</nova:project>
Apr 13 21:49:19 user nova-compute[71325]:       </nova:owner>
Apr 13 21:49:19 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:49:19 user nova-compute[71325]:       <nova:ports>
Apr 13 21:49:19 user nova-compute[71325]:         <nova:port uuid="f0a7bc69-be17-49d2-94fc-40541afce8ed">
Apr 13 21:49:19 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 21:49:19 user nova-compute[71325]:         </nova:port>
Apr 13 21:49:19 user nova-compute[71325]:       </nova:ports>
Apr 13 21:49:19 user nova-compute[71325]:     </nova:instance>
Apr 13 21:49:19 user nova-compute[71325]:   </metadata>
Apr 13 21:49:19 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:49:19 user nova-compute[71325]:     <system>
Apr 13 21:49:19 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:49:19 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:49:19 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:49:19 user nova-compute[71325]:       <entry name="serial">af4efbd5-a4c1-4e7c-b274-92413f86f2a8</entry>
Apr 13 21:49:19 user nova-compute[71325]:       <entry name="uuid">af4efbd5-a4c1-4e7c-b274-92413f86f2a8</entry>
Apr 13 21:49:19 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:49:19 user nova-compute[71325]:     </system>
Apr 13 21:49:19 user nova-compute[71325]:   </sysinfo>
Apr 13 21:49:19 user nova-compute[71325]:   <os>
Apr 13 21:49:19 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:49:19 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:49:19 user nova-compute[71325]:   </os>
Apr 13 21:49:19 user nova-compute[71325]:   <features>
Apr 13 21:49:19 user nova-compute[71325]:     <acpi/>
Apr 13 21:49:19 user nova-compute[71325]:     <apic/>
Apr 13 21:49:19 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:49:19 user nova-compute[71325]:   </features>
Apr 13 21:49:19 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:49:19 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:49:19 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:49:19 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:49:19 user nova-compute[71325]:   </clock>
Apr 13 21:49:19 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:49:19 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:49:19 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:49:19 user nova-compute[71325]:   </cpu>
Apr 13 21:49:19 user nova-compute[71325]:   <devices>
Apr 13 21:49:19 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:49:19 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:49:19 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk"/>
Apr 13 21:49:19 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:49:19 user nova-compute[71325]:     </disk>
Apr 13 21:49:19 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:49:19 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:49:19 user nova-compute[71325]:       <source dev="/dev/sdd"/>
Apr 13 21:49:19 user nova-compute[71325]:       <target dev="vdb" bus="virtio"/>
Apr 13 21:49:19 user nova-compute[71325]:       <serial>5b928772-e4f8-489b-93b3-282f3c7c184b</serial>
Apr 13 21:49:19 user nova-compute[71325]:     </disk>
Apr 13 21:49:19 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:49:19 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:49:19 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.rescue"/>
Apr 13 21:49:19 user nova-compute[71325]:       <target dev="vdc" bus="virtio"/>
Apr 13 21:49:19 user nova-compute[71325]:       <boot order="1"/>
Apr 13 21:49:19 user nova-compute[71325]:     </disk>
Apr 13 21:49:19 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:49:19 user nova-compute[71325]:       <mac address="fa:16:3e:f2:21:5b"/>
Apr 13 21:49:19 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:49:19 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:49:19 user nova-compute[71325]:       <target dev="tapf0a7bc69-be"/>
Apr 13 21:49:19 user nova-compute[71325]:     </interface>
Apr 13 21:49:19 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:49:19 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/console.log" append="off"/>
Apr 13 21:49:19 user nova-compute[71325]:     </serial>
Apr 13 21:49:19 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:49:19 user nova-compute[71325]:     <video>
Apr 13 21:49:19 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:49:19 user nova-compute[71325]:     </video>
Apr 13 21:49:19 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:49:19 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:49:19 user nova-compute[71325]:     </rng>
Apr 13 21:49:19 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:49:19 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:49:19 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:49:19 user nova-compute[71325]:     </memballoon>
Apr 13 21:49:19 user nova-compute[71325]:   </devices>
Apr 13 21:49:19 user nova-compute[71325]: </domain>
Apr 13 21:49:19 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:49:19 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Instance destroyed successfully.
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:49:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] No VIF found with MAC fa:16:3e:f2:21:5b, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-5ddc56bc-0cb5-4957-97f7-b78853928061 req-c3b0134a-4696-478d-b7c9-ba0c25a5b557 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5ddc56bc-0cb5-4957-97f7-b78853928061 req-c3b0134a-4696-478d-b7c9-ba0c25a5b557 service nova] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5ddc56bc-0cb5-4957-97f7-b78853928061 req-c3b0134a-4696-478d-b7c9-ba0c25a5b557 service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5ddc56bc-0cb5-4957-97f7-b78853928061 req-c3b0134a-4696-478d-b7c9-ba0c25a5b557 service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-5ddc56bc-0cb5-4957-97f7-b78853928061 req-c3b0134a-4696-478d-b7c9-ba0c25a5b557 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] No waiting events found dispatching network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:22 user nova-compute[71325]: WARNING nova.compute.manager [req-5ddc56bc-0cb5-4957-97f7-b78853928061 req-c3b0134a-4696-478d-b7c9-ba0c25a5b557 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received unexpected event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed for instance with vm_state active and task_state rescuing.
Apr 13 21:49:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:24 user nova-compute[71325]: DEBUG nova.compute.manager [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:24 user nova-compute[71325]: DEBUG nova.compute.manager [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] No waiting events found dispatching network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:24 user nova-compute[71325]: WARNING nova.compute.manager [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received unexpected event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed for instance with vm_state active and task_state rescuing.
Apr 13 21:49:24 user nova-compute[71325]: DEBUG nova.compute.manager [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:24 user nova-compute[71325]: DEBUG nova.compute.manager [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] No waiting events found dispatching network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:24 user nova-compute[71325]: WARNING nova.compute.manager [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received unexpected event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 21:49:24 user nova-compute[71325]: DEBUG nova.compute.manager [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:24 user nova-compute[71325]: DEBUG nova.compute.manager [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] No waiting events found dispatching network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:24 user nova-compute[71325]: WARNING nova.compute.manager [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received unexpected event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 21:49:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422565.19706, eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:49:25 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] VM Resumed (Lifecycle Event)
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:25 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Instance spawned successfully.
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:49:25 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422565.204132, eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:49:25 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] VM Started (Lifecycle Event)
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:49:25 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for af4efbd5-a4c1-4e7c-b274-92413f86f2a8 due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422565.205492, af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:49:25 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] VM Resumed (Lifecycle Event)
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422565.205696, af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:49:25 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] VM Started (Lifecycle Event)
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:49:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.430s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:54 user nova-compute[71325]: INFO nova.compute.manager [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Rescuing
Apr 13 21:49:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:49:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquired lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:49:54 user nova-compute[71325]: DEBUG nova.network.neutron [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:49:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:54 user nova-compute[71325]: DEBUG nova.network.neutron [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Updating instance_info_cache with network_info: [{"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:49:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Releasing lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:49:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-104a1836-20c2-4994-bd42-29a97fb914e8 req-c0326087-3e22-41e4-a757-02febd5d3079 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-vif-unplugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-104a1836-20c2-4994-bd42-29a97fb914e8 req-c0326087-3e22-41e4-a757-02febd5d3079 service nova] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-104a1836-20c2-4994-bd42-29a97fb914e8 req-c0326087-3e22-41e4-a757-02febd5d3079 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-104a1836-20c2-4994-bd42-29a97fb914e8 req-c0326087-3e22-41e4-a757-02febd5d3079 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-104a1836-20c2-4994-bd42-29a97fb914e8 req-c0326087-3e22-41e4-a757-02febd5d3079 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] No waiting events found dispatching network-vif-unplugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:55 user nova-compute[71325]: WARNING nova.compute.manager [req-104a1836-20c2-4994-bd42-29a97fb914e8 req-c0326087-3e22-41e4-a757-02febd5d3079 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received unexpected event network-vif-unplugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance with vm_state active and task_state rescuing.
Apr 13 21:49:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:55 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Instance destroyed successfully.
Apr 13 21:49:55 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Attempting rescue
Apr 13 21:49:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71325) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Instance directory exists: not creating {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 21:49:55 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Creating image(s)
Apr 13 21:49:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "/opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "/opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "/opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG nova.objects.instance [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'trusted_certs' on Instance uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.rescue {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.rescue" returned: 0 in 0.052s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG nova.objects.instance [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'migration_context' on Instance uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Start _get_guest_xml network_info=[{"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "vif_mac": "fa:16:3e:40:c1:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG nova.objects.instance [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'resources' on Instance uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:55 user nova-compute[71325]: DEBUG nova.objects.instance [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'numa_topology' on Instance uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:56 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:49:56 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.objects.instance [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'vcpu_model' on Instance uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-579437522',display_name='tempest-ServerRescueNegativeTestJSON-server-579437522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-579437522',id=1,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70e84a09a76a44eb830e575db4321224',ramdisk_id='',reservation_id='r-pepi5puo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-546430736',owner_user_name='tempest-ServerRescueNegativeTestJSON-546430736-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:45:30Z,user_data=None,user_id='e77459bc3fa8496da1a089c460e32ed2',uuid=f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "vif_mac": "fa:16:3e:40:c1:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converting VIF {"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "vif_mac": "fa:16:3e:40:c1:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:c1:d3,bridge_name='br-int',has_traffic_filtering=True,id=fdc6b9f2-62b6-44df-a2e4-e923e1e57964,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc6b9f2-62') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.objects.instance [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'pci_devices' on Instance uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:49:56 user nova-compute[71325]:   <uuid>f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de</uuid>
Apr 13 21:49:56 user nova-compute[71325]:   <name>instance-00000001</name>
Apr 13 21:49:56 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:49:56 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:49:56 user nova-compute[71325]:   <metadata>
Apr 13 21:49:56 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:49:56 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:49:56 user nova-compute[71325]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-579437522</nova:name>
Apr 13 21:49:56 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:49:56</nova:creationTime>
Apr 13 21:49:56 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:49:56 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:49:56 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:49:56 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:49:56 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:49:56 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:49:56 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:49:56 user nova-compute[71325]:       <nova:owner>
Apr 13 21:49:56 user nova-compute[71325]:         <nova:user uuid="e77459bc3fa8496da1a089c460e32ed2">tempest-ServerRescueNegativeTestJSON-546430736-project-member</nova:user>
Apr 13 21:49:56 user nova-compute[71325]:         <nova:project uuid="70e84a09a76a44eb830e575db4321224">tempest-ServerRescueNegativeTestJSON-546430736</nova:project>
Apr 13 21:49:56 user nova-compute[71325]:       </nova:owner>
Apr 13 21:49:56 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:49:56 user nova-compute[71325]:       <nova:ports>
Apr 13 21:49:56 user nova-compute[71325]:         <nova:port uuid="fdc6b9f2-62b6-44df-a2e4-e923e1e57964">
Apr 13 21:49:56 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 21:49:56 user nova-compute[71325]:         </nova:port>
Apr 13 21:49:56 user nova-compute[71325]:       </nova:ports>
Apr 13 21:49:56 user nova-compute[71325]:     </nova:instance>
Apr 13 21:49:56 user nova-compute[71325]:   </metadata>
Apr 13 21:49:56 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:49:56 user nova-compute[71325]:     <system>
Apr 13 21:49:56 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:49:56 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:49:56 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:49:56 user nova-compute[71325]:       <entry name="serial">f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de</entry>
Apr 13 21:49:56 user nova-compute[71325]:       <entry name="uuid">f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de</entry>
Apr 13 21:49:56 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:49:56 user nova-compute[71325]:     </system>
Apr 13 21:49:56 user nova-compute[71325]:   </sysinfo>
Apr 13 21:49:56 user nova-compute[71325]:   <os>
Apr 13 21:49:56 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:49:56 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:49:56 user nova-compute[71325]:   </os>
Apr 13 21:49:56 user nova-compute[71325]:   <features>
Apr 13 21:49:56 user nova-compute[71325]:     <acpi/>
Apr 13 21:49:56 user nova-compute[71325]:     <apic/>
Apr 13 21:49:56 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:49:56 user nova-compute[71325]:   </features>
Apr 13 21:49:56 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:49:56 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:49:56 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:49:56 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:49:56 user nova-compute[71325]:   </clock>
Apr 13 21:49:56 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:49:56 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:49:56 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:49:56 user nova-compute[71325]:   </cpu>
Apr 13 21:49:56 user nova-compute[71325]:   <devices>
Apr 13 21:49:56 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:49:56 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:49:56 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.rescue"/>
Apr 13 21:49:56 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:49:56 user nova-compute[71325]:     </disk>
Apr 13 21:49:56 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:49:56 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:49:56 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk"/>
Apr 13 21:49:56 user nova-compute[71325]:       <target dev="vdb" bus="virtio"/>
Apr 13 21:49:56 user nova-compute[71325]:     </disk>
Apr 13 21:49:56 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:49:56 user nova-compute[71325]:       <mac address="fa:16:3e:40:c1:d3"/>
Apr 13 21:49:56 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:49:56 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:49:56 user nova-compute[71325]:       <target dev="tapfdc6b9f2-62"/>
Apr 13 21:49:56 user nova-compute[71325]:     </interface>
Apr 13 21:49:56 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:49:56 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/console.log" append="off"/>
Apr 13 21:49:56 user nova-compute[71325]:     </serial>
Apr 13 21:49:56 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:49:56 user nova-compute[71325]:     <video>
Apr 13 21:49:56 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:49:56 user nova-compute[71325]:     </video>
Apr 13 21:49:56 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:49:56 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:49:56 user nova-compute[71325]:     </rng>
Apr 13 21:49:56 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:49:56 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:49:56 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:49:56 user nova-compute[71325]:     </memballoon>
Apr 13 21:49:56 user nova-compute[71325]:   </devices>
Apr 13 21:49:56 user nova-compute[71325]: </domain>
Apr 13 21:49:56 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:49:56 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Instance destroyed successfully.
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:49:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No VIF found with MAC fa:16:3e:40:c1:d3, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:49:57 user nova-compute[71325]: DEBUG nova.compute.manager [req-d20818a3-328a-4df2-aa87-4ba696aef2f8 req-3304ca48-644a-4597-91e1-2816cbfe4833 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d20818a3-328a-4df2-aa87-4ba696aef2f8 req-3304ca48-644a-4597-91e1-2816cbfe4833 service nova] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d20818a3-328a-4df2-aa87-4ba696aef2f8 req-3304ca48-644a-4597-91e1-2816cbfe4833 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d20818a3-328a-4df2-aa87-4ba696aef2f8 req-3304ca48-644a-4597-91e1-2816cbfe4833 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:57 user nova-compute[71325]: DEBUG nova.compute.manager [req-d20818a3-328a-4df2-aa87-4ba696aef2f8 req-3304ca48-644a-4597-91e1-2816cbfe4833 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] No waiting events found dispatching network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:57 user nova-compute[71325]: WARNING nova.compute.manager [req-d20818a3-328a-4df2-aa87-4ba696aef2f8 req-3304ca48-644a-4597-91e1-2816cbfe4833 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received unexpected event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance with vm_state active and task_state rescuing.
Apr 13 21:49:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG nova.compute.manager [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG nova.compute.manager [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] No waiting events found dispatching network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:59 user nova-compute[71325]: WARNING nova.compute.manager [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received unexpected event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance with vm_state active and task_state rescuing.
Apr 13 21:49:59 user nova-compute[71325]: DEBUG nova.compute.manager [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG nova.compute.manager [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] No waiting events found dispatching network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:49:59 user nova-compute[71325]: WARNING nova.compute.manager [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received unexpected event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance with vm_state active and task_state rescuing.
Apr 13 21:49:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422599.878292, f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:49:59 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] VM Resumed (Lifecycle Event)
Apr 13 21:49:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:49:59 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 21:49:59 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422599.8812993, f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:49:59 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] VM Started (Lifecycle Event)
Apr 13 21:49:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:49:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:50:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:00 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:50:00 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:50:00 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:50:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:00 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:50:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:50:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:50:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:50:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:50:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:06 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:50:06 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7383MB free_disk=26.269439697265625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance be81f393-654b-4b50-856e-00818f3ae59e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance fe05a421-ee64-492b-a338-0e864458908c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance a631dfd9-935a-444d-9b8e-082345fd4413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:50:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:50:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:50:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:50:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:07 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:50:08 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updating instance_info_cache with network_info: [{"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:50:08 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:50:08 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:50:08 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:50:08 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:50:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:50:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-5d721f93-b952-4996-b15a-3d5812fd5899 req-15a38e3a-762f-4b9e-85b7-f787a38d1cb4 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-changed-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-5d721f93-b952-4996-b15a-3d5812fd5899 req-15a38e3a-762f-4b9e-85b7-f787a38d1cb4 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Refreshing instance network info cache due to event network-changed-03480082-c22f-4ad9-bc15-d536f115ec88. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5d721f93-b952-4996-b15a-3d5812fd5899 req-15a38e3a-762f-4b9e-85b7-f787a38d1cb4 service nova] Acquiring lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5d721f93-b952-4996-b15a-3d5812fd5899 req-15a38e3a-762f-4b9e-85b7-f787a38d1cb4 service nova] Acquired lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:17 user nova-compute[71325]: DEBUG nova.network.neutron [req-5d721f93-b952-4996-b15a-3d5812fd5899 req-15a38e3a-762f-4b9e-85b7-f787a38d1cb4 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Refreshing network info cache for port 03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:17 user nova-compute[71325]: DEBUG nova.network.neutron [req-5d721f93-b952-4996-b15a-3d5812fd5899 req-15a38e3a-762f-4b9e-85b7-f787a38d1cb4 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updated VIF entry in instance network info cache for port 03480082-c22f-4ad9-bc15-d536f115ec88. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:50:17 user nova-compute[71325]: DEBUG nova.network.neutron [req-5d721f93-b952-4996-b15a-3d5812fd5899 req-15a38e3a-762f-4b9e-85b7-f787a38d1cb4 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating instance_info_cache with network_info: [{"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5d721f93-b952-4996-b15a-3d5812fd5899 req-15a38e3a-762f-4b9e-85b7-f787a38d1cb4 service nova] Releasing lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:26 user nova-compute[71325]: DEBUG nova.compute.manager [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:50:27 user nova-compute[71325]: INFO nova.compute.claims [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Claim successful on node user
Apr 13 21:50:27 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG nova.compute.manager [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG nova.compute.manager [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:50:27 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:50:27 user nova-compute[71325]: DEBUG nova.compute.manager [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:50:27 user nova-compute[71325]: INFO nova.virt.block_device [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Booting with volume 366d4c6a-2de6-4848-8c15-d7cd841bafd6 at /dev/vda
Apr 13 21:50:27 user nova-compute[71325]: DEBUG nova.policy [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '331c3fa2628d466c9ae2729e269a5332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2edca40d96494b8530f49a89dbd6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG os_brick.utils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b810349e-834f-4ea3-8338-fa9f24d868cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb78788-7812-4398-964e-4b693a9c4079]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a005422a-0904-4264-8426-4a3b1259cc8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe6360c-9410-4f66-aed5-aed2f496f716]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:50:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:50:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:50:28 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:50:28 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d214b485-1272-49ef-8c36-2042a84f1c87]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:50:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:50:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:50:28 user nova-compute[71325]: DEBUG os_brick.utils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:50:28 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating existing volume attachment record: 56f9a229-2f1e-4e77-9621-57708f1e78f4 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:50:28 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Successfully created port: 24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:50:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:29 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Successfully created port: 7587c8c4-a480-4db1-be69-2e60fbd6e27b {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:50:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:30 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Successfully created port: 5be52063-b3a4-42e7-ba9c-7791634309ac {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "a631dfd9-935a-444d-9b8e-082345fd4413" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "a631dfd9-935a-444d-9b8e-082345fd4413" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:31 user nova-compute[71325]: INFO nova.compute.manager [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Terminating instance
Apr 13 21:50:31 user nova-compute[71325]: DEBUG nova.compute.manager [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Successfully created port: 9f031ddd-e857-4075-9b14-e71dd6581d72 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG nova.compute.manager [req-1d68f105-18b1-4934-9da1-675891e48263 req-49029310-e679-44ef-ae7c-e1ad514f8cc9 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Received event network-vif-unplugged-75e0cbd0-5c75-400a-94e3-4cf30eea2093 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1d68f105-18b1-4934-9da1-675891e48263 req-49029310-e679-44ef-ae7c-e1ad514f8cc9 service nova] Acquiring lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1d68f105-18b1-4934-9da1-675891e48263 req-49029310-e679-44ef-ae7c-e1ad514f8cc9 service nova] Lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1d68f105-18b1-4934-9da1-675891e48263 req-49029310-e679-44ef-ae7c-e1ad514f8cc9 service nova] Lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG nova.compute.manager [req-1d68f105-18b1-4934-9da1-675891e48263 req-49029310-e679-44ef-ae7c-e1ad514f8cc9 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] No waiting events found dispatching network-vif-unplugged-75e0cbd0-5c75-400a-94e3-4cf30eea2093 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:31 user nova-compute[71325]: DEBUG nova.compute.manager [req-1d68f105-18b1-4934-9da1-675891e48263 req-49029310-e679-44ef-ae7c-e1ad514f8cc9 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Received event network-vif-unplugged-75e0cbd0-5c75-400a-94e3-4cf30eea2093 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:50:32 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Instance destroyed successfully.
Apr 13 21:50:32 user nova-compute[71325]: DEBUG nova.objects.instance [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lazy-loading 'resources' on Instance uuid a631dfd9-935a-444d-9b8e-082345fd4413 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:50:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:48:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1692528565',display_name='tempest-VolumesAdminNegativeTest-server-1692528565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1692528565',id=15,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:48:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03a67a9a0d514f19b6cc0b39477a1b42',ramdisk_id='',reservation_id='r-dxv4f7m4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1461294072',owner_user_name='tempest-VolumesAdminNegativeTest-1461294072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:48:43Z,user_data=None,user_id='97e87956414a49c4b3c34e51fe6ed2ec',uuid=a631dfd9-935a-444d-9b8e-082345fd4413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "address": "fa:16:3e:3d:fb:22", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e0cbd0-5c", "ovs_interfaceid": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:50:32 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Converting VIF {"id": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "address": "fa:16:3e:3d:fb:22", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e0cbd0-5c", "ovs_interfaceid": "75e0cbd0-5c75-400a-94e3-4cf30eea2093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:32 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=75e0cbd0-5c75-400a-94e3-4cf30eea2093,network=Network(25a51e04-88d5-45b8-865b-f2c7da7460b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e0cbd0-5c') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:32 user nova-compute[71325]: DEBUG os_vif [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=75e0cbd0-5c75-400a-94e3-4cf30eea2093,network=Network(25a51e04-88d5-45b8-865b-f2c7da7460b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e0cbd0-5c') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:50:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75e0cbd0-5c, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:50:32 user nova-compute[71325]: INFO os_vif [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=75e0cbd0-5c75-400a-94e3-4cf30eea2093,network=Network(25a51e04-88d5-45b8-865b-f2c7da7460b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e0cbd0-5c')
Apr 13 21:50:32 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Deleting instance files /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413_del
Apr 13 21:50:32 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Deletion of /opt/stack/data/nova/instances/a631dfd9-935a-444d-9b8e-082345fd4413_del complete
Apr 13 21:50:32 user nova-compute[71325]: INFO nova.compute.manager [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Took 1.10 seconds to destroy the instance on the hypervisor.
Apr 13 21:50:32 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:50:32 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:50:32 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:33 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Took 1.16 seconds to deallocate network for instance.
Apr 13 21:50:33 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Successfully created port: 6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:33 user nova-compute[71325]: INFO nova.virt.block_device [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Booting with volume 8c3610f8-edc3-44d8-8282-e0da72d4ef12 at /dev/vdb
Apr 13 21:50:33 user nova-compute[71325]: DEBUG os_brick.utils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[374a6eb0-2b77-42b8-876b-395e7050cbca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e75077-76e0-4798-b93a-a2d4cca8d798]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[95878314-789f-4e58-88da-dd280ff570ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1ac13a-455b-4a4a-8b48-83d74ef899d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:50:33 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b2619f-426f-4df9-ad6f-14e24fb17611]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG os_brick.utils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating existing volume attachment record: fecbdbb2-b145-4bbd-8517-274498690240 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG nova.compute.manager [req-0594b72b-a160-4525-ae68-0434f8550e74 req-994a9ec6-559c-4a25-9edb-4ae3900c1b72 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Received event network-vif-plugged-75e0cbd0-5c75-400a-94e3-4cf30eea2093 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0594b72b-a160-4525-ae68-0434f8550e74 req-994a9ec6-559c-4a25-9edb-4ae3900c1b72 service nova] Acquiring lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0594b72b-a160-4525-ae68-0434f8550e74 req-994a9ec6-559c-4a25-9edb-4ae3900c1b72 service nova] Lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0594b72b-a160-4525-ae68-0434f8550e74 req-994a9ec6-559c-4a25-9edb-4ae3900c1b72 service nova] Lock "a631dfd9-935a-444d-9b8e-082345fd4413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG nova.compute.manager [req-0594b72b-a160-4525-ae68-0434f8550e74 req-994a9ec6-559c-4a25-9edb-4ae3900c1b72 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] No waiting events found dispatching network-vif-plugged-75e0cbd0-5c75-400a-94e3-4cf30eea2093 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:33 user nova-compute[71325]: WARNING nova.compute.manager [req-0594b72b-a160-4525-ae68-0434f8550e74 req-994a9ec6-559c-4a25-9edb-4ae3900c1b72 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Received unexpected event network-vif-plugged-75e0cbd0-5c75-400a-94e3-4cf30eea2093 for instance with vm_state deleted and task_state None.
Apr 13 21:50:33 user nova-compute[71325]: DEBUG nova.compute.manager [req-0594b72b-a160-4525-ae68-0434f8550e74 req-994a9ec6-559c-4a25-9edb-4ae3900c1b72 service nova] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Received event network-vif-deleted-75e0cbd0-5c75-400a-94e3-4cf30eea2093 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:50:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.515s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:34 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Deleted allocations for instance a631dfd9-935a-444d-9b8e-082345fd4413
Apr 13 21:50:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "a631dfd9-935a-444d-9b8e-082345fd4413" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.041s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:34 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Successfully updated port: 24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:50:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:35 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Successfully updated port: 5f66c487-d522-409e-b066-9b0ae3da1bcb {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-changed-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing instance network info cache due to event network-changed-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] Acquiring lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] Acquired lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing network info cache for port 24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Successfully updated port: 0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] Releasing lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-changed-5f66c487-d522-409e-b066-9b0ae3da1bcb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing instance network info cache due to event network-changed-5f66c487-d522-409e-b066-9b0ae3da1bcb. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] Acquiring lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] Acquired lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing network info cache for port 5f66c487-d522-409e-b066-9b0ae3da1bcb {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:50:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] Releasing lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:37 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Successfully updated port: 7587c8c4-a480-4db1-be69-2e60fbd6e27b {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-changed-0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing instance network info cache due to event network-changed-0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] Acquiring lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] Acquired lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG nova.network.neutron [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing network info cache for port 0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG nova.network.neutron [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:50:38 user nova-compute[71325]: INFO nova.virt.block_device [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Booting with volume e0989634-7097-4ab3-9e8a-4d49e6953fb3 at /dev/vdc
Apr 13 21:50:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Successfully updated port: 5be52063-b3a4-42e7-ba9c-7791634309ac {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG os_brick.utils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c4ca20-8b77-475f-9460-3e4027040c50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1950e6-0690-4006-b088-1fa5224627d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fec237f-8fd9-4d91-9eb7-a72dc174376b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b7af23-749f-4df6-b2e9-8b455c923cdd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:50:38 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8e350e-3569-4ce9-bdf9-c64ff0818ddd]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG os_brick.utils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating existing volume attachment record: 771ee7bc-846b-4b2f-b0f1-36af301ae20b {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG nova.network.neutron [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] Releasing lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-changed-7587c8c4-a480-4db1-be69-2e60fbd6e27b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing instance network info cache due to event network-changed-7587c8c4-a480-4db1-be69-2e60fbd6e27b. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] Acquiring lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] Acquired lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:38 user nova-compute[71325]: DEBUG nova.network.neutron [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing network info cache for port 7587c8c4-a480-4db1-be69-2e60fbd6e27b {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:39 user nova-compute[71325]: DEBUG nova.network.neutron [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:50:39 user nova-compute[71325]: DEBUG nova.network.neutron [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] Releasing lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-d6037877-1d42-47ec-a4e2-c60099b79e03 req-ccc03ff5-375f-4dac-b23e-f8742dc8434f service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-changed-5be52063-b3a4-42e7-ba9c-7791634309ac {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-d6037877-1d42-47ec-a4e2-c60099b79e03 req-ccc03ff5-375f-4dac-b23e-f8742dc8434f service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing instance network info cache due to event network-changed-5be52063-b3a4-42e7-ba9c-7791634309ac. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d6037877-1d42-47ec-a4e2-c60099b79e03 req-ccc03ff5-375f-4dac-b23e-f8742dc8434f service nova] Acquiring lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d6037877-1d42-47ec-a4e2-c60099b79e03 req-ccc03ff5-375f-4dac-b23e-f8742dc8434f service nova] Acquired lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:40 user nova-compute[71325]: DEBUG nova.network.neutron [req-d6037877-1d42-47ec-a4e2-c60099b79e03 req-ccc03ff5-375f-4dac-b23e-f8742dc8434f service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing network info cache for port 5be52063-b3a4-42e7-ba9c-7791634309ac {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:40 user nova-compute[71325]: DEBUG nova.network.neutron [req-d6037877-1d42-47ec-a4e2-c60099b79e03 req-ccc03ff5-375f-4dac-b23e-f8742dc8434f service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:50:40 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Successfully updated port: 9f031ddd-e857-4075-9b14-e71dd6581d72 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:50:40 user nova-compute[71325]: DEBUG nova.network.neutron [req-d6037877-1d42-47ec-a4e2-c60099b79e03 req-ccc03ff5-375f-4dac-b23e-f8742dc8434f service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d6037877-1d42-47ec-a4e2-c60099b79e03 req-ccc03ff5-375f-4dac-b23e-f8742dc8434f service nova] Releasing lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-7b31d357-8d6e-4334-b6df-aec0cb1733c2 req-f010d5b6-4da2-45dd-aea8-d17691447651 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-changed-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-7b31d357-8d6e-4334-b6df-aec0cb1733c2 req-f010d5b6-4da2-45dd-aea8-d17691447651 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Refreshing instance network info cache due to event network-changed-a6dc784b-1fab-4f4b-8e84-8df1f191b373. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7b31d357-8d6e-4334-b6df-aec0cb1733c2 req-f010d5b6-4da2-45dd-aea8-d17691447651 service nova] Acquiring lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7b31d357-8d6e-4334-b6df-aec0cb1733c2 req-f010d5b6-4da2-45dd-aea8-d17691447651 service nova] Acquired lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:40 user nova-compute[71325]: DEBUG nova.network.neutron [req-7b31d357-8d6e-4334-b6df-aec0cb1733c2 req-f010d5b6-4da2-45dd-aea8-d17691447651 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Refreshing network info cache for port a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-aabe7414-b86d-4ea9-8870-f5f4b82a3f14 req-04c4bd31-0030-463d-a2c3-35f16b07b0e0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-changed-9f031ddd-e857-4075-9b14-e71dd6581d72 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-aabe7414-b86d-4ea9-8870-f5f4b82a3f14 req-04c4bd31-0030-463d-a2c3-35f16b07b0e0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing instance network info cache due to event network-changed-9f031ddd-e857-4075-9b14-e71dd6581d72. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aabe7414-b86d-4ea9-8870-f5f4b82a3f14 req-04c4bd31-0030-463d-a2c3-35f16b07b0e0 service nova] Acquiring lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aabe7414-b86d-4ea9-8870-f5f4b82a3f14 req-04c4bd31-0030-463d-a2c3-35f16b07b0e0 service nova] Acquired lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG nova.network.neutron [req-aabe7414-b86d-4ea9-8870-f5f4b82a3f14 req-04c4bd31-0030-463d-a2c3-35f16b07b0e0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing network info cache for port 9f031ddd-e857-4075-9b14-e71dd6581d72 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG nova.network.neutron [req-aabe7414-b86d-4ea9-8870-f5f4b82a3f14 req-04c4bd31-0030-463d-a2c3-35f16b07b0e0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "fe05a421-ee64-492b-a338-0e864458908c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:42 user nova-compute[71325]: INFO nova.compute.manager [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Detaching volume 58713f9a-6c26-4fe7-a2bc-967c96ddcc4c
Apr 13 21:50:42 user nova-compute[71325]: INFO nova.virt.block_device [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Attempting to driver detach volume 58713f9a-6c26-4fe7-a2bc-967c96ddcc4c from mountpoint /dev/vdb
Apr 13 21:50:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Attempting to detach device vdb from instance fe05a421-ee64-492b-a338-0e864458908c from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:50:42 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:50:42 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:50:42 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:50:42 user nova-compute[71325]:   <serial>58713f9a-6c26-4fe7-a2bc-967c96ddcc4c</serial>
Apr 13 21:50:42 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 21:50:42 user nova-compute[71325]: </disk>
Apr 13 21:50:42 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:50:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Successfully detached device vdb from instance fe05a421-ee64-492b-a338-0e864458908c from the persistent domain config.
Apr 13 21:50:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe05a421-ee64-492b-a338-0e864458908c from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:50:42 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:50:42 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:50:42 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:50:42 user nova-compute[71325]:   <serial>58713f9a-6c26-4fe7-a2bc-967c96ddcc4c</serial>
Apr 13 21:50:42 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 21:50:42 user nova-compute[71325]: </disk>
Apr 13 21:50:42 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG nova.network.neutron [req-7b31d357-8d6e-4334-b6df-aec0cb1733c2 req-f010d5b6-4da2-45dd-aea8-d17691447651 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updated VIF entry in instance network info cache for port a6dc784b-1fab-4f4b-8e84-8df1f191b373. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG nova.network.neutron [req-7b31d357-8d6e-4334-b6df-aec0cb1733c2 req-f010d5b6-4da2-45dd-aea8-d17691447651 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updating instance_info_cache with network_info: [{"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG nova.network.neutron [req-aabe7414-b86d-4ea9-8870-f5f4b82a3f14 req-04c4bd31-0030-463d-a2c3-35f16b07b0e0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7b31d357-8d6e-4334-b6df-aec0cb1733c2 req-f010d5b6-4da2-45dd-aea8-d17691447651 service nova] Releasing lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aabe7414-b86d-4ea9-8870-f5f4b82a3f14 req-04c4bd31-0030-463d-a2c3-35f16b07b0e0 service nova] Releasing lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-a760cc3d-19eb-45fe-8804-842244b6de9d req-c2ab25b6-f6fd-445b-ab35-7fcdef171b96 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-changed-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-a760cc3d-19eb-45fe-8804-842244b6de9d req-c2ab25b6-f6fd-445b-ab35-7fcdef171b96 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Refreshing instance network info cache due to event network-changed-a6dc784b-1fab-4f4b-8e84-8df1f191b373. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a760cc3d-19eb-45fe-8804-842244b6de9d req-c2ab25b6-f6fd-445b-ab35-7fcdef171b96 service nova] Acquiring lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a760cc3d-19eb-45fe-8804-842244b6de9d req-c2ab25b6-f6fd-445b-ab35-7fcdef171b96 service nova] Acquired lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.network.neutron [req-a760cc3d-19eb-45fe-8804-842244b6de9d req-c2ab25b6-f6fd-445b-ab35-7fcdef171b96 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Refreshing network info cache for port a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681422643.0991175, fe05a421-ee64-492b-a338-0e864458908c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Successfully updated port: 6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe05a421-ee64-492b-a338-0e864458908c {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:50:43 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Successfully detached device vdb from instance fe05a421-ee64-492b-a338-0e864458908c from the live domain config.
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUdWXroA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:50:43 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquired lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[531b38fb-ba9a-4d73-92fc-9c697477dcf7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:50:43 user nova-compute[71325]: No targets found.
Apr 13 21:50:43 user nova-compute[71325]: iSNS:
Apr 13 21:50:43 user nova-compute[71325]: No targets found.
Apr 13 21:50:43 user nova-compute[71325]: STATIC:
Apr 13 21:50:43 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae
Apr 13 21:50:43 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:43 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:43 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c
Apr 13 21:50:43 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:43 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:43 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b
Apr 13 21:50:43 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:43 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:43 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474
Apr 13 21:50:43 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:43 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:43 user nova-compute[71325]: FIRMWARE:
Apr 13 21:50:43 user nova-compute[71325]: No targets found.
Apr 13 21:50:43 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:50:43 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:50:43 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9883a0-2f84-4e5d-ae7e-bc5d18375b57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[56da716f-aafb-4466-bb44-efb727e534f8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:50:43 user nova-compute[71325]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:43 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:43 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:43 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c (non-flash)
Apr 13 21:50:43 user nova-compute[71325]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:43 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:43 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:43 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c424a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c'): ({'sdc'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Removing single pathed devices sdc {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0b1800-61af-4a2c-8081-cd208bc098df]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f4ad42-b669-45ed-a434-ef69487ff277]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Flushing IO for device /dev/sdc {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b41f75-c2db-4951-8cab-db53650109ae]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4142b903-58d2-405a-bfe1-279341db4511]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0008c49-aab0-4f12-9d1f-4791200e7c5b]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6764009b-61d8-4351-945c-2a872f3b1fcf]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260]
Apr 13 21:50:43 user nova-compute[71325]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c, portal: 172.16.0.220,3260] successful.
Apr 13 21:50:43 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58713f9a-6c26-4fe7-a2bc-967c96ddcc4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d7074b-f81c-4f09-bed2-67bc5dbb3a9d]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] <== disconnect_volume: return (339ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:50:43 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Creating image(s)
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Ensure instance console log exists: /opt/stack/data/nova/instances/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.network.neutron [req-a760cc3d-19eb-45fe-8804-842244b6de9d req-c2ab25b6-f6fd-445b-ab35-7fcdef171b96 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updated VIF entry in instance network info cache for port a6dc784b-1fab-4f4b-8e84-8df1f191b373. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG nova.network.neutron [req-a760cc3d-19eb-45fe-8804-842244b6de9d req-c2ab25b6-f6fd-445b-ab35-7fcdef171b96 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updating instance_info_cache with network_info: [{"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a760cc3d-19eb-45fe-8804-842244b6de9d req-c2ab25b6-f6fd-445b-ab35-7fcdef171b96 service nova] Releasing lock "refresh_cache-fe05a421-ee64-492b-a338-0e864458908c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:44 user nova-compute[71325]: DEBUG nova.objects.instance [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'flavor' on Instance uuid fe05a421-ee64-492b-a338-0e864458908c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:50:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "fe05a421-ee64-492b-a338-0e864458908c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.813s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-6d27000a-e883-4668-a167-3fb6d5efc6f1 req-66a08bda-3562-4d35-a363-8a13dcb6f0b9 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-changed-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-6d27000a-e883-4668-a167-3fb6d5efc6f1 req-66a08bda-3562-4d35-a363-8a13dcb6f0b9 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing instance network info cache due to event network-changed-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6d27000a-e883-4668-a167-3fb6d5efc6f1 req-66a08bda-3562-4d35-a363-8a13dcb6f0b9 service nova] Acquiring lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:50:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:50:44 user nova-compute[71325]: INFO nova.compute.claims [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Claim successful on node user
Apr 13 21:50:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:44 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:50:44 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:50:45 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:50:45 user nova-compute[71325]: INFO nova.virt.block_device [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Booting with volume fb5cba55-94c2-4da0-9227-07704d15f763 at /dev/vda
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.utils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.policy [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2446d7b79d7f4879ab857ab6a10777aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f969510e1734ad4bf48a8c0a3d7ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[009564e7-883f-450a-984d-41a44b612b44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30a8251-7494-460b-9469-6ccb0ed2795b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13faf66-fc4b-48ad-af39-e2543c2f5168]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f4272a-a4c6-4fa0-8a5a-a1cd8f4e6b4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [{"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "address": "fa:16:3e:b9:95:3c", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7587c8c4-a4", "ovs_interfaceid": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5be52063-b3a4-42e7-ba9c-7791634309ac", "address": "fa:16:3e:a0:f4:f4", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5be52063-b3", "ovs_interfaceid": "5be52063-b3a4-42e7-ba9c-7791634309ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f031ddd-e857-4075-9b14-e71dd6581d72", "address": "fa:16:3e:7f:c6:93", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f031ddd-e8", "ovs_interfaceid": "9f031ddd-e857-4075-9b14-e71dd6581d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "address": "fa:16:3e:e6:3d:82", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dfbfb87-41", "ovs_interfaceid": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Releasing lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Instance network_info: |[{"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "address": "fa:16:3e:b9:95:3c", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7587c8c4-a4", "ovs_interfaceid": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5be52063-b3a4-42e7-ba9c-7791634309ac", "address": "fa:16:3e:a0:f4:f4", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5be52063-b3", "ovs_interfaceid": "5be52063-b3a4-42e7-ba9c-7791634309ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f031ddd-e857-4075-9b14-e71dd6581d72", "address": "fa:16:3e:7f:c6:93", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f031ddd-e8", "ovs_interfaceid": "9f031ddd-e857-4075-9b14-e71dd6581d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "address": "fa:16:3e:e6:3d:82", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dfbfb87-41", "ovs_interfaceid": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:50:45 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d8a686-707d-4d83-9628-6b948cfcc6aa]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6d27000a-e883-4668-a167-3fb6d5efc6f1 req-66a08bda-3562-4d35-a363-8a13dcb6f0b9 service nova] Acquired lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.network.neutron [req-6d27000a-e883-4668-a167-3fb6d5efc6f1 req-66a08bda-3562-4d35-a363-8a13dcb6f0b9 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing network info cache for port 6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Start _get_guest_xml network_info=[{"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "address": "fa:16:3e:b9:95:3c", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7587c8c4-a4", "ovs_interfaceid": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5be52063-b3a4-42e7-ba9c-7791634309ac", "address": "fa:16:3e:a0:f4:f4", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5be52063-b3", "ovs_interfaceid": "5be52063-b3a4-42e7-ba9c-7791634309ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f031ddd-e857-4075-9b14-e71dd6581d72", "address": "fa:16:3e:7f:c6:93", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f031ddd-e8", "ovs_interfaceid": "9f031ddd-e857-4075-9b14-e71dd6581d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "address": "fa:16:3e:e6:3d:82", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dfbfb87-41", "ovs_interfaceid": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSKNHQEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7905fecf-f246-4ed8-a5d4-9abdd3fb9cac', 'attached_at': '', 'detached_at': '', 'volume_id': '366d4c6a-2de6-4848-8c15-d7cd841bafd6', 'serial': '366d4c6a-2de6-4848-8c15-d7cd841bafd6'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '56f9a229-2f1e-4e77-9621-57708f1e78f4', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TWHtJKmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7905fecf-f246-4ed8-a5d4-9abdd3fb9cac', 'attached_at': '', 'detached_at': '', 'volume_id': '8c3610f8-edc3-44d8-8282-e0da72d4ef12', 'serial': '8c3610f8-edc3-44d8-8282-e0da72d4ef12'}, 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'fecbdbb2-b145-4bbd-8517-274498690240', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zkoJBlyE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7905fecf-f246-4ed8-a5d4-9abdd3fb9cac', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0989634-7097-4ab3-9e8a-4d49e6953fb3', 'serial': 'e0989634-7097-4ab3-9e8a-4d49e6953fb3'}, 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '771ee7bc-846b-4b2f-b0f1-36af301ae20b', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.utils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating existing volume attachment record: 91310226-1ad8-476f-8cfd-977c36bd78bb {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:50:45 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:50:45 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSKNHQEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:50:45 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:50:45 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:50:45 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c177f531-265d-490c-b879-fdf4eb9ad857]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:50:45 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d273e0-0967-4ea2-9dfd-945fbb596729]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6] added
Apr 13 21:50:45 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[75922b0f-d006-483a-acec-cf4f5b60f01f]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[db532dda-3207-4adf-8d10-49aa8ef7f010]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSKNHQEv {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSKNHQEv" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9780400e-8e32-404e-bfe2-a5234aea9961]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bSKNHQEv'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab3b5e7-0b43-4110-b384-a84af5a1086c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af87751-f94d-4f11-bb7a-0e85aabcf3bc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:45 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:45 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:45 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:45 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:45 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:45 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7a28f1-e43f-4f0a-b514-184b15269b67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6, portal: 172.16.0.220,3260]
Apr 13 21:50:45 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6, portal: 172.16.0.220,3260] successful.
Apr 13 21:50:45 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb95a788-42f0-431f-a5f2-1c2eb7791ddf]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[069a4dfe-95db-4368-a98a-d79b5554c1ca]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:45 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:45 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:45 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:50:45 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:45 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:45 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:45 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:50:45 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c057da-912a-4275-ac37-78e0eec51edf]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSKNHQEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.network.neutron [req-6d27000a-e883-4668-a167-3fb6d5efc6f1 req-66a08bda-3562-4d35-a363-8a13dcb6f0b9 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updated VIF entry in instance network info cache for port 6dfbfb87-4182-4cef-b879-4e6cbbe7ed51. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:50:45 user nova-compute[71325]: DEBUG nova.network.neutron [req-6d27000a-e883-4668-a167-3fb6d5efc6f1 req-66a08bda-3562-4d35-a363-8a13dcb6f0b9 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [{"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "address": "fa:16:3e:b9:95:3c", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7587c8c4-a4", "ovs_interfaceid": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5be52063-b3a4-42e7-ba9c-7791634309ac", "address": "fa:16:3e:a0:f4:f4", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5be52063-b3", "ovs_interfaceid": "5be52063-b3a4-42e7-ba9c-7791634309ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f031ddd-e857-4075-9b14-e71dd6581d72", "address": "fa:16:3e:7f:c6:93", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f031ddd-e8", "ovs_interfaceid": "9f031ddd-e857-4075-9b14-e71dd6581d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "address": "fa:16:3e:e6:3d:82", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dfbfb87-41", "ovs_interfaceid": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6d27000a-e883-4668-a167-3fb6d5efc6f1 req-66a08bda-3562-4d35-a363-8a13dcb6f0b9 service nova] Releasing lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Successfully created port: 2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Successfully created port: 75e50a64-fb53-4613-b7b5-3cc00b4b9458 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26365626162333463', 'path': '/dev/sdc'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365626162333463', 'path': '/dev/sdc'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TWHtJKmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:50:46 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:50:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:50:46 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:50:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:50:46 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[faffaeab-cd97-4fa2-a083-f4ea7ee5084e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:50:46 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b83d575-ea90-4c4b-a64d-3484e44d1c16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12] added
Apr 13 21:50:46 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[10731c97-47c5-480e-8f44-1b74cbbfc7ac]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a12bb16-a223-401c-a8a1-b59f3e5d0ae4]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TWHtJKmF {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TWHtJKmF" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f28bf60-e761-4f6f-ae7a-9445cfe26314]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TWHtJKmF'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cd16b0-10df-4215-be0d-d4af4f3f4949]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422632.0573199, a631dfd9-935a-444d-9b8e-082345fd4413 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:50:47 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] VM Stopped (Lifecycle Event)
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d523440-98bc-4514-bbf4-6d20ff509590]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:47 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:47 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:47 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:50:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:47 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:47 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:47 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:50:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG nova.compute.manager [None req-670a6606-960d-43a2-a247-c9927f93cb14 None None] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2822670e-952b-4fe9-950e-7747eadfd32b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12, portal: 172.16.0.220,3260]
Apr 13 21:50:47 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12, portal: 172.16.0.220,3260] successful.
Apr 13 21:50:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee528bc2-9d32-441d-b931-eb7f91f0de34]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b6efd7-1322-4940-987c-747672393e6c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:47 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:47 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:47 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:50:47 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:50:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:47 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:47 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:47 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:50:47 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:50:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] HCTL ('37', '-', '-', 0) found on session 16 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Successfully created port: 0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fdb7f4-91dd-4217-8911-82856d66c1f6]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: None {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:50:47 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Successfully created port: f239b75b-16b7-4fcd-b3e3-d65f10278c43 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TWHtJKmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23034663236613063', 'path': '/dev/sdf'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034663236613063', 'path': '/dev/sdf'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zkoJBlyE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:50:48 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:50:48 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:50:48 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc23d3dc-ab63-4b8d-84a8-f69c55ea2277]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:50:48 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b78e90c-1a3f-4597-b940-3ed9c1faf5ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3] added
Apr 13 21:50:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c783c38f-13ad-4cef-b308-a4e2a064b896]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a9f6da-5224-4bce-92fc-3e17a1e89769]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zkoJBlyE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zkoJBlyE" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b205710-e47c-420d-9fb8-1f8f6e26c723]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zkoJBlyE'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a78554-c66c-4a5d-86d5-3fb44b3f95e3]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e4a95e-f401-4d7e-9bde-e4d86cbea836]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:50:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:50:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64b8f9c-202c-4260-82a5-855de6a888cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3, portal: 172.16.0.220,3260]
Apr 13 21:50:48 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3, portal: 172.16.0.220,3260] successful.
Apr 13 21:50:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d79c1cd-3770-47a2-9873-f59082858487]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[faeb99b2-7f7d-4c21-9918-bb52e1614de8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:50:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:50:48 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:50:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] HCTL ('38', '-', '-', 0) found on session 17 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Successfully created port: 38028ec5-f65f-44d7-a8f8-bc4470278334 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[359b4498-d66e-49f2-85d9-8ee5ea3f9d6b]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:50:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zkoJBlyE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Successfully updated port: 2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-962e4379-eec2-4274-8837-24e6ccdebd2f req-52637a3d-15cd-40cf-9ca2-024021036f3f service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-changed-2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-962e4379-eec2-4274-8837-24e6ccdebd2f req-52637a3d-15cd-40cf-9ca2-024021036f3f service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing instance network info cache due to event network-changed-2ade8fab-1fde-4730-aacc-fcb3b613c402. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-962e4379-eec2-4274-8837-24e6ccdebd2f req-52637a3d-15cd-40cf-9ca2-024021036f3f service nova] Acquiring lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-962e4379-eec2-4274-8837-24e6ccdebd2f req-52637a3d-15cd-40cf-9ca2-024021036f3f service nova] Acquired lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.neutron [req-962e4379-eec2-4274-8837-24e6ccdebd2f req-52637a3d-15cd-40cf-9ca2-024021036f3f service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing network info cache for port 2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.neutron [req-962e4379-eec2-4274-8837-24e6ccdebd2f req-52637a3d-15cd-40cf-9ca2-024021036f3f service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23838316264373337', 'path': '/dev/sdg'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838316264373337', 'path': '/dev/sdg'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:e2:7c,bridge_name='br-int',has_traffic_filtering=True,id=24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2,network=Network(b84d8f07-7c73-4678-b29a-132f1a373d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b3ada6-d0') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:d6:1b,bridge_name='br-int',has_traffic_filtering=True,id=5f66c487-d522-409e-b066-9b0ae3da1bcb,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f66c487-d5') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9f:60,bridge_name='br-int',has_traffic_filtering=True,id=0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0e47caf0-d3') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "address": "fa:16:3e:b9:95:3c", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7587c8c4-a4", "ovs_interfaceid": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "address": "fa:16:3e:b9:95:3c", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7587c8c4-a4", "ovs_interfaceid": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:95:3c,bridge_name='br-int',has_traffic_filtering=True,id=7587c8c4-a480-4db1-be69-2e60fbd6e27b,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7587c8c4-a4') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5be52063-b3a4-42e7-ba9c-7791634309ac", "address": "fa:16:3e:a0:f4:f4", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5be52063-b3", "ovs_interfaceid": "5be52063-b3a4-42e7-ba9c-7791634309ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "5be52063-b3a4-42e7-ba9c-7791634309ac", "address": "fa:16:3e:a0:f4:f4", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5be52063-b3", "ovs_interfaceid": "5be52063-b3a4-42e7-ba9c-7791634309ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:f4:f4,bridge_name='br-int',has_traffic_filtering=True,id=5be52063-b3a4-42e7-ba9c-7791634309ac,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5be52063-b3') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f031ddd-e857-4075-9b14-e71dd6581d72", "address": "fa:16:3e:7f:c6:93", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f031ddd-e8", "ovs_interfaceid": "9f031ddd-e857-4075-9b14-e71dd6581d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "9f031ddd-e857-4075-9b14-e71dd6581d72", "address": "fa:16:3e:7f:c6:93", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f031ddd-e8", "ovs_interfaceid": "9f031ddd-e857-4075-9b14-e71dd6581d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c6:93,bridge_name='br-int',has_traffic_filtering=True,id=9f031ddd-e857-4075-9b14-e71dd6581d72,network=Network(d1a760f7-e484-4699-85e9-3e88a9e4b7aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f031ddd-e8') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "address": "fa:16:3e:e6:3d:82", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dfbfb87-41", "ovs_interfaceid": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "address": "fa:16:3e:e6:3d:82", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dfbfb87-41", "ovs_interfaceid": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3d:82,bridge_name='br-int',has_traffic_filtering=True,id=6dfbfb87-4182-4cef-b879-4e6cbbe7ed51,network=Network(d1a760f7-e484-4699-85e9-3e88a9e4b7aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dfbfb87-41') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.objects.instance [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lazy-loading 'pci_devices' on Instance uuid 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:50:49 user nova-compute[71325]:   <uuid>7905fecf-f246-4ed8-a5d4-9abdd3fb9cac</uuid>
Apr 13 21:50:49 user nova-compute[71325]:   <name>instance-00000011</name>
Apr 13 21:50:49 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:50:49 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:50:49 user nova-compute[71325]:   <metadata>
Apr 13 21:50:49 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:50:49 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:50:49 user nova-compute[71325]:       <nova:name>tempest-device-tagging-server-1170693670</nova:name>
Apr 13 21:50:49 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:50:45</nova:creationTime>
Apr 13 21:50:49 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:50:49 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:50:49 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:50:49 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:50:49 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:50:49 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:50:49 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:50:49 user nova-compute[71325]:       <nova:owner>
Apr 13 21:50:49 user nova-compute[71325]:         <nova:user uuid="331c3fa2628d466c9ae2729e269a5332">tempest-TaggedBootDevicesTest_v242-438641289-project-member</nova:user>
Apr 13 21:50:49 user nova-compute[71325]:         <nova:project uuid="8a2edca40d96494b8530f49a89dbd6e6">tempest-TaggedBootDevicesTest_v242-438641289</nova:project>
Apr 13 21:50:49 user nova-compute[71325]:       </nova:owner>
Apr 13 21:50:49 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:50:49 user nova-compute[71325]:       <nova:ports>
Apr 13 21:50:49 user nova-compute[71325]:         <nova:port uuid="24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2">
Apr 13 21:50:49 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 21:50:49 user nova-compute[71325]:         </nova:port>
Apr 13 21:50:49 user nova-compute[71325]:         <nova:port uuid="5f66c487-d522-409e-b066-9b0ae3da1bcb">
Apr 13 21:50:49 user nova-compute[71325]:           <nova:ip type="fixed" address="10.1.1.167" ipVersion="4"/>
Apr 13 21:50:49 user nova-compute[71325]:         </nova:port>
Apr 13 21:50:49 user nova-compute[71325]:         <nova:port uuid="0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac">
Apr 13 21:50:49 user nova-compute[71325]:           <nova:ip type="fixed" address="10.1.1.131" ipVersion="4"/>
Apr 13 21:50:49 user nova-compute[71325]:         </nova:port>
Apr 13 21:50:49 user nova-compute[71325]:         <nova:port uuid="7587c8c4-a480-4db1-be69-2e60fbd6e27b">
Apr 13 21:50:49 user nova-compute[71325]:           <nova:ip type="fixed" address="10.1.1.143" ipVersion="4"/>
Apr 13 21:50:49 user nova-compute[71325]:         </nova:port>
Apr 13 21:50:49 user nova-compute[71325]:         <nova:port uuid="5be52063-b3a4-42e7-ba9c-7791634309ac">
Apr 13 21:50:49 user nova-compute[71325]:           <nova:ip type="fixed" address="10.1.1.158" ipVersion="4"/>
Apr 13 21:50:49 user nova-compute[71325]:         </nova:port>
Apr 13 21:50:49 user nova-compute[71325]:         <nova:port uuid="9f031ddd-e857-4075-9b14-e71dd6581d72">
Apr 13 21:50:49 user nova-compute[71325]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 13 21:50:49 user nova-compute[71325]:         </nova:port>
Apr 13 21:50:49 user nova-compute[71325]:         <nova:port uuid="6dfbfb87-4182-4cef-b879-4e6cbbe7ed51">
Apr 13 21:50:49 user nova-compute[71325]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 13 21:50:49 user nova-compute[71325]:         </nova:port>
Apr 13 21:50:49 user nova-compute[71325]:       </nova:ports>
Apr 13 21:50:49 user nova-compute[71325]:     </nova:instance>
Apr 13 21:50:49 user nova-compute[71325]:   </metadata>
Apr 13 21:50:49 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:50:49 user nova-compute[71325]:     <system>
Apr 13 21:50:49 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:50:49 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:50:49 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:50:49 user nova-compute[71325]:       <entry name="serial">7905fecf-f246-4ed8-a5d4-9abdd3fb9cac</entry>
Apr 13 21:50:49 user nova-compute[71325]:       <entry name="uuid">7905fecf-f246-4ed8-a5d4-9abdd3fb9cac</entry>
Apr 13 21:50:49 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:50:49 user nova-compute[71325]:     </system>
Apr 13 21:50:49 user nova-compute[71325]:   </sysinfo>
Apr 13 21:50:49 user nova-compute[71325]:   <os>
Apr 13 21:50:49 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:50:49 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:50:49 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:50:49 user nova-compute[71325]:   </os>
Apr 13 21:50:49 user nova-compute[71325]:   <features>
Apr 13 21:50:49 user nova-compute[71325]:     <acpi/>
Apr 13 21:50:49 user nova-compute[71325]:     <apic/>
Apr 13 21:50:49 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:50:49 user nova-compute[71325]:   </features>
Apr 13 21:50:49 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:50:49 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:50:49 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:50:49 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:50:49 user nova-compute[71325]:   </clock>
Apr 13 21:50:49 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:50:49 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:50:49 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:50:49 user nova-compute[71325]:   </cpu>
Apr 13 21:50:49 user nova-compute[71325]:   <devices>
Apr 13 21:50:49 user nova-compute[71325]:     <disk type="file" device="cdrom">
Apr 13 21:50:49 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 21:50:49 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac/disk.config"/>
Apr 13 21:50:49 user nova-compute[71325]:       <target dev="hda" bus="ide"/>
Apr 13 21:50:49 user nova-compute[71325]:     </disk>
Apr 13 21:50:49 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:50:49 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:50:49 user nova-compute[71325]:       <source dev="/dev/sdc"/>
Apr 13 21:50:49 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:50:49 user nova-compute[71325]:       <serial>366d4c6a-2de6-4848-8c15-d7cd841bafd6</serial>
Apr 13 21:50:49 user nova-compute[71325]:     </disk>
Apr 13 21:50:49 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:50:49 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:50:49 user nova-compute[71325]:       <source dev="/dev/sdf"/>
Apr 13 21:50:49 user nova-compute[71325]:       <target dev="vdb" bus="virtio"/>
Apr 13 21:50:49 user nova-compute[71325]:       <serial>8c3610f8-edc3-44d8-8282-e0da72d4ef12</serial>
Apr 13 21:50:49 user nova-compute[71325]:     </disk>
Apr 13 21:50:49 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:50:49 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:50:49 user nova-compute[71325]:       <source dev="/dev/sdg"/>
Apr 13 21:50:49 user nova-compute[71325]:       <target dev="vdc" bus="virtio"/>
Apr 13 21:50:49 user nova-compute[71325]:       <serial>e0989634-7097-4ab3-9e8a-4d49e6953fb3</serial>
Apr 13 21:50:49 user nova-compute[71325]:     </disk>
Apr 13 21:50:49 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:50:49 user nova-compute[71325]:       <mac address="fa:16:3e:69:e2:7c"/>
Apr 13 21:50:49 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:50:49 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:50:49 user nova-compute[71325]:       <target dev="tap24b3ada6-d0"/>
Apr 13 21:50:49 user nova-compute[71325]:     </interface>
Apr 13 21:50:49 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:50:49 user nova-compute[71325]:       <mac address="fa:16:3e:10:d6:1b"/>
Apr 13 21:50:49 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:50:49 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:50:49 user nova-compute[71325]:       <target dev="tap5f66c487-d5"/>
Apr 13 21:50:49 user nova-compute[71325]:     </interface>
Apr 13 21:50:49 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:50:49 user nova-compute[71325]:       <mac address="fa:16:3e:e1:9f:60"/>
Apr 13 21:50:49 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:50:49 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:50:49 user nova-compute[71325]:       <target dev="tap0e47caf0-d3"/>
Apr 13 21:50:49 user nova-compute[71325]:     </interface>
Apr 13 21:50:49 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:50:49 user nova-compute[71325]:       <mac address="fa:16:3e:b9:95:3c"/>
Apr 13 21:50:49 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:50:49 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:50:49 user nova-compute[71325]:       <target dev="tap7587c8c4-a4"/>
Apr 13 21:50:49 user nova-compute[71325]:     </interface>
Apr 13 21:50:49 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:50:49 user nova-compute[71325]:       <mac address="fa:16:3e:a0:f4:f4"/>
Apr 13 21:50:49 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:50:49 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:50:49 user nova-compute[71325]:       <target dev="tap5be52063-b3"/>
Apr 13 21:50:49 user nova-compute[71325]:     </interface>
Apr 13 21:50:49 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:50:49 user nova-compute[71325]:       <mac address="fa:16:3e:7f:c6:93"/>
Apr 13 21:50:49 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:50:49 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:50:49 user nova-compute[71325]:       <target dev="tap9f031ddd-e8"/>
Apr 13 21:50:49 user nova-compute[71325]:     </interface>
Apr 13 21:50:49 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:50:49 user nova-compute[71325]:       <mac address="fa:16:3e:e6:3d:82"/>
Apr 13 21:50:49 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:50:49 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:50:49 user nova-compute[71325]:       <target dev="tap6dfbfb87-41"/>
Apr 13 21:50:49 user nova-compute[71325]:     </interface>
Apr 13 21:50:49 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:50:49 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac/console.log" append="off"/>
Apr 13 21:50:49 user nova-compute[71325]:     </serial>
Apr 13 21:50:49 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:50:49 user nova-compute[71325]:     <video>
Apr 13 21:50:49 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:50:49 user nova-compute[71325]:     </video>
Apr 13 21:50:49 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:50:49 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:50:49 user nova-compute[71325]:     </rng>
Apr 13 21:50:49 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:50:49 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:50:49 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:50:49 user nova-compute[71325]:     </memballoon>
Apr 13 21:50:49 user nova-compute[71325]:   </devices>
Apr 13 21:50:49 user nova-compute[71325]: </domain>
Apr 13 21:50:49 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:e2:7c,bridge_name='br-int',has_traffic_filtering=True,id=24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2,network=Network(b84d8f07-7c73-4678-b29a-132f1a373d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b3ada6-d0') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG os_vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:e2:7c,bridge_name='br-int',has_traffic_filtering=True,id=24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2,network=Network(b84d8f07-7c73-4678-b29a-132f1a373d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b3ada6-d0') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24b3ada6-d0, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap24b3ada6-d0, col_values=(('external_ids', {'iface-id': '24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:e2:7c', 'vm-uuid': '7905fecf-f246-4ed8-a5d4-9abdd3fb9cac'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: INFO os_vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:e2:7c,bridge_name='br-int',has_traffic_filtering=True,id=24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2,network=Network(b84d8f07-7c73-4678-b29a-132f1a373d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b3ada6-d0')
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:d6:1b,bridge_name='br-int',has_traffic_filtering=True,id=5f66c487-d522-409e-b066-9b0ae3da1bcb,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f66c487-d5') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG os_vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:d6:1b,bridge_name='br-int',has_traffic_filtering=True,id=5f66c487-d522-409e-b066-9b0ae3da1bcb,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f66c487-d5') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f66c487-d5, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f66c487-d5, col_values=(('external_ids', {'iface-id': '5f66c487-d522-409e-b066-9b0ae3da1bcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:d6:1b', 'vm-uuid': '7905fecf-f246-4ed8-a5d4-9abdd3fb9cac'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: INFO os_vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:d6:1b,bridge_name='br-int',has_traffic_filtering=True,id=5f66c487-d522-409e-b066-9b0ae3da1bcb,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f66c487-d5')
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9f:60,bridge_name='br-int',has_traffic_filtering=True,id=0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0e47caf0-d3') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG os_vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9f:60,bridge_name='br-int',has_traffic_filtering=True,id=0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0e47caf0-d3') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e47caf0-d3, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e47caf0-d3, col_values=(('external_ids', {'iface-id': '0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:9f:60', 'vm-uuid': '7905fecf-f246-4ed8-a5d4-9abdd3fb9cac'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: INFO os_vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9f:60,bridge_name='br-int',has_traffic_filtering=True,id=0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0e47caf0-d3')
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "address": "fa:16:3e:b9:95:3c", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7587c8c4-a4", "ovs_interfaceid": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "address": "fa:16:3e:b9:95:3c", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7587c8c4-a4", "ovs_interfaceid": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:95:3c,bridge_name='br-int',has_traffic_filtering=True,id=7587c8c4-a480-4db1-be69-2e60fbd6e27b,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7587c8c4-a4') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG os_vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:95:3c,bridge_name='br-int',has_traffic_filtering=True,id=7587c8c4-a480-4db1-be69-2e60fbd6e27b,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7587c8c4-a4') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.neutron [req-962e4379-eec2-4274-8837-24e6ccdebd2f req-52637a3d-15cd-40cf-9ca2-024021036f3f service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7587c8c4-a4, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7587c8c4-a4, col_values=(('external_ids', {'iface-id': '7587c8c4-a480-4db1-be69-2e60fbd6e27b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:95:3c', 'vm-uuid': '7905fecf-f246-4ed8-a5d4-9abdd3fb9cac'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-962e4379-eec2-4274-8837-24e6ccdebd2f req-52637a3d-15cd-40cf-9ca2-024021036f3f service nova] Releasing lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: INFO os_vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:95:3c,bridge_name='br-int',has_traffic_filtering=True,id=7587c8c4-a480-4db1-be69-2e60fbd6e27b,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7587c8c4-a4')
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5be52063-b3a4-42e7-ba9c-7791634309ac", "address": "fa:16:3e:a0:f4:f4", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5be52063-b3", "ovs_interfaceid": "5be52063-b3a4-42e7-ba9c-7791634309ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "5be52063-b3a4-42e7-ba9c-7791634309ac", "address": "fa:16:3e:a0:f4:f4", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5be52063-b3", "ovs_interfaceid": "5be52063-b3a4-42e7-ba9c-7791634309ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:f4:f4,bridge_name='br-int',has_traffic_filtering=True,id=5be52063-b3a4-42e7-ba9c-7791634309ac,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5be52063-b3') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG os_vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:f4:f4,bridge_name='br-int',has_traffic_filtering=True,id=5be52063-b3a4-42e7-ba9c-7791634309ac,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5be52063-b3') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5be52063-b3, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5be52063-b3, col_values=(('external_ids', {'iface-id': '5be52063-b3a4-42e7-ba9c-7791634309ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:f4:f4', 'vm-uuid': '7905fecf-f246-4ed8-a5d4-9abdd3fb9cac'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: INFO os_vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:f4:f4,bridge_name='br-int',has_traffic_filtering=True,id=5be52063-b3a4-42e7-ba9c-7791634309ac,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5be52063-b3')
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f031ddd-e857-4075-9b14-e71dd6581d72", "address": "fa:16:3e:7f:c6:93", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f031ddd-e8", "ovs_interfaceid": "9f031ddd-e857-4075-9b14-e71dd6581d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "9f031ddd-e857-4075-9b14-e71dd6581d72", "address": "fa:16:3e:7f:c6:93", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f031ddd-e8", "ovs_interfaceid": "9f031ddd-e857-4075-9b14-e71dd6581d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c6:93,bridge_name='br-int',has_traffic_filtering=True,id=9f031ddd-e857-4075-9b14-e71dd6581d72,network=Network(d1a760f7-e484-4699-85e9-3e88a9e4b7aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f031ddd-e8') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG os_vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c6:93,bridge_name='br-int',has_traffic_filtering=True,id=9f031ddd-e857-4075-9b14-e71dd6581d72,network=Network(d1a760f7-e484-4699-85e9-3e88a9e4b7aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f031ddd-e8') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f031ddd-e8, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f031ddd-e8, col_values=(('external_ids', {'iface-id': '9f031ddd-e857-4075-9b14-e71dd6581d72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:c6:93', 'vm-uuid': '7905fecf-f246-4ed8-a5d4-9abdd3fb9cac'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:50 user nova-compute[71325]: INFO os_vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c6:93,bridge_name='br-int',has_traffic_filtering=True,id=9f031ddd-e857-4075-9b14-e71dd6581d72,network=Network(d1a760f7-e484-4699-85e9-3e88a9e4b7aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f031ddd-e8')
Apr 13 21:50:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "address": "fa:16:3e:e6:3d:82", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dfbfb87-41", "ovs_interfaceid": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "address": "fa:16:3e:e6:3d:82", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dfbfb87-41", "ovs_interfaceid": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3d:82,bridge_name='br-int',has_traffic_filtering=True,id=6dfbfb87-4182-4cef-b879-4e6cbbe7ed51,network=Network(d1a760f7-e484-4699-85e9-3e88a9e4b7aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dfbfb87-41') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG os_vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3d:82,bridge_name='br-int',has_traffic_filtering=True,id=6dfbfb87-4182-4cef-b879-4e6cbbe7ed51,network=Network(d1a760f7-e484-4699-85e9-3e88a9e4b7aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dfbfb87-41') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6dfbfb87-41, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6dfbfb87-41, col_values=(('external_ids', {'iface-id': '6dfbfb87-4182-4cef-b879-4e6cbbe7ed51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:3d:82', 'vm-uuid': '7905fecf-f246-4ed8-a5d4-9abdd3fb9cac'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:50 user nova-compute[71325]: INFO os_vif [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3d:82,bridge_name='br-int',has_traffic_filtering=True,id=6dfbfb87-4182-4cef-b879-4e6cbbe7ed51,network=Network(d1a760f7-e484-4699-85e9-3e88a9e4b7aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dfbfb87-41')
Apr 13 21:50:50 user nova-compute[71325]: INFO nova.virt.block_device [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Booting with volume 47d1ab68-19d7-42ea-95eb-ce2536260227 at /dev/vdb
Apr 13 21:50:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] No BDM found with device name hda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] No VIF found with MAC fa:16:3e:69:e2:7c, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] No VIF found with MAC fa:16:3e:a0:f4:f4, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:50:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Using config drive
Apr 13 21:50:50 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Successfully updated port: 079a7af6-43b0-4f03-a24a-b54d0e9a1c89 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG os_brick.utils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffecbd63-631b-420f-bb37-47c4631d31e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55be4e8-8912-4c6c-a133-9848e67519aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea3779f-f948-4932-9682-eac53eada70c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bfc39a-eefe-45c8-b3be-a3a0d9083d04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:50:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Creating config drive at /opt/stack/data/nova/instances/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac/disk.config
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpc5z4om4w {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:50:50 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a569d2-3cff-4eb3-bfac-5c8c3c17c011]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG os_brick.utils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating existing volume attachment record: 495eacd6-b61f-4ae4-8b43-71f6bbf147aa {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:50:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpc5z4om4w" returned: 0 in 0.079s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Successfully updated port: 7062c9f1-5719-4d6b-8b6a-efbb377c078b {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-0ea3a6ac-6abd-422c-a508-5117acba925a req-33371db9-4a15-46d9-9e49-22b9f555767b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-changed-7062c9f1-5719-4d6b-8b6a-efbb377c078b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-0ea3a6ac-6abd-422c-a508-5117acba925a req-33371db9-4a15-46d9-9e49-22b9f555767b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing instance network info cache due to event network-changed-7062c9f1-5719-4d6b-8b6a-efbb377c078b. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0ea3a6ac-6abd-422c-a508-5117acba925a req-33371db9-4a15-46d9-9e49-22b9f555767b service nova] Acquiring lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0ea3a6ac-6abd-422c-a508-5117acba925a req-33371db9-4a15-46d9-9e49-22b9f555767b service nova] Acquired lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG nova.network.neutron [req-0ea3a6ac-6abd-422c-a508-5117acba925a req-33371db9-4a15-46d9-9e49-22b9f555767b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing network info cache for port 7062c9f1-5719-4d6b-8b6a-efbb377c078b {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG nova.network.neutron [req-0ea3a6ac-6abd-422c-a508-5117acba925a req-33371db9-4a15-46d9-9e49-22b9f555767b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG nova.network.neutron [req-0ea3a6ac-6abd-422c-a508-5117acba925a req-33371db9-4a15-46d9-9e49-22b9f555767b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0ea3a6ac-6abd-422c-a508-5117acba925a req-33371db9-4a15-46d9-9e49-22b9f555767b service nova] Releasing lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-b812f593-9ae5-4496-b460-0fb5bbe84db4 req-358f554f-5137-4b6c-8b9b-dfb1a97c2af7 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-changed-079a7af6-43b0-4f03-a24a-b54d0e9a1c89 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-b812f593-9ae5-4496-b460-0fb5bbe84db4 req-358f554f-5137-4b6c-8b9b-dfb1a97c2af7 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing instance network info cache due to event network-changed-079a7af6-43b0-4f03-a24a-b54d0e9a1c89. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b812f593-9ae5-4496-b460-0fb5bbe84db4 req-358f554f-5137-4b6c-8b9b-dfb1a97c2af7 service nova] Acquiring lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b812f593-9ae5-4496-b460-0fb5bbe84db4 req-358f554f-5137-4b6c-8b9b-dfb1a97c2af7 service nova] Acquired lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG nova.network.neutron [req-b812f593-9ae5-4496-b460-0fb5bbe84db4 req-358f554f-5137-4b6c-8b9b-dfb1a97c2af7 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing network info cache for port 079a7af6-43b0-4f03-a24a-b54d0e9a1c89 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG nova.network.neutron [req-b812f593-9ae5-4496-b460-0fb5bbe84db4 req-358f554f-5137-4b6c-8b9b-dfb1a97c2af7 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:51 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Successfully updated port: 75e50a64-fb53-4613-b7b5-3cc00b4b9458 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-f2da930d-9d07-4d39-8d44-905854cdecb4 req-6fa0777e-0a0b-4979-8181-cdb6e2a332fd service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f2da930d-9d07-4d39-8d44-905854cdecb4 req-6fa0777e-0a0b-4979-8181-cdb6e2a332fd service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f2da930d-9d07-4d39-8d44-905854cdecb4 req-6fa0777e-0a0b-4979-8181-cdb6e2a332fd service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f2da930d-9d07-4d39-8d44-905854cdecb4 req-6fa0777e-0a0b-4979-8181-cdb6e2a332fd service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-f2da930d-9d07-4d39-8d44-905854cdecb4 req-6fa0777e-0a0b-4979-8181-cdb6e2a332fd service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:52 user nova-compute[71325]: WARNING nova.compute.manager [req-f2da930d-9d07-4d39-8d44-905854cdecb4 req-6fa0777e-0a0b-4979-8181-cdb6e2a332fd service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 for instance with vm_state building and task_state spawning.
Apr 13 21:50:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG nova.network.neutron [req-b812f593-9ae5-4496-b460-0fb5bbe84db4 req-358f554f-5137-4b6c-8b9b-dfb1a97c2af7 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b812f593-9ae5-4496-b460-0fb5bbe84db4 req-358f554f-5137-4b6c-8b9b-dfb1a97c2af7 service nova] Releasing lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:52 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Successfully updated port: 0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-changed-75e50a64-fb53-4613-b7b5-3cc00b4b9458 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing instance network info cache due to event network-changed-75e50a64-fb53-4613-b7b5-3cc00b4b9458. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] Acquiring lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] Acquired lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.network.neutron [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing network info cache for port 75e50a64-fb53-4613-b7b5-3cc00b4b9458 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.network.neutron [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.network.neutron [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-5f66c487-d522-409e-b066-9b0ae3da1bcb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-5f66c487-d522-409e-b066-9b0ae3da1bcb {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:53 user nova-compute[71325]: WARNING nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-5f66c487-d522-409e-b066-9b0ae3da1bcb for instance with vm_state building and task_state spawning.
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-5f66c487-d522-409e-b066-9b0ae3da1bcb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-5f66c487-d522-409e-b066-9b0ae3da1bcb {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:53 user nova-compute[71325]: WARNING nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-5f66c487-d522-409e-b066-9b0ae3da1bcb for instance with vm_state building and task_state spawning.
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:53 user nova-compute[71325]: WARNING nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac for instance with vm_state building and task_state spawning.
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:53 user nova-compute[71325]: WARNING nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac for instance with vm_state building and task_state spawning.
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-7587c8c4-a480-4db1-be69-2e60fbd6e27b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-7587c8c4-a480-4db1-be69-2e60fbd6e27b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:53 user nova-compute[71325]: WARNING nova.compute.manager [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-7587c8c4-a480-4db1-be69-2e60fbd6e27b for instance with vm_state building and task_state spawning.
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] Releasing lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-changed-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing instance network info cache due to event network-changed-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] Acquiring lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] Acquired lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.network.neutron [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing network info cache for port 0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG nova.network.neutron [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Successfully updated port: f239b75b-16b7-4fcd-b3e3-d65f10278c43 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:54 user nova-compute[71325]: WARNING nova.compute.manager [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 for instance with vm_state building and task_state spawning.
Apr 13 21:50:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-9f031ddd-e857-4075-9b14-e71dd6581d72 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-9f031ddd-e857-4075-9b14-e71dd6581d72 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:54 user nova-compute[71325]: WARNING nova.compute.manager [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-9f031ddd-e857-4075-9b14-e71dd6581d72 for instance with vm_state building and task_state spawning.
Apr 13 21:50:54 user nova-compute[71325]: DEBUG nova.network.neutron [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] Releasing lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Successfully updated port: 38028ec5-f65f-44d7-a8f8-bc4470278334 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquired lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:55 user nova-compute[71325]: INFO nova.compute.manager [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Detaching volume a325d973-036d-409b-af0a-cae00a2d5474
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-changed-f239b75b-16b7-4fcd-b3e3-d65f10278c43 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing instance network info cache due to event network-changed-f239b75b-16b7-4fcd-b3e3-d65f10278c43. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Acquiring lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:55 user nova-compute[71325]: INFO nova.virt.block_device [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Attempting to driver detach volume a325d973-036d-409b-af0a-cae00a2d5474 from mountpoint /dev/vdc
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Attempting to detach device vdc from instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:50:55 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:50:55 user nova-compute[71325]:   <source dev="/dev/sde"/>
Apr 13 21:50:55 user nova-compute[71325]:   <target dev="vdc" bus="virtio"/>
Apr 13 21:50:55 user nova-compute[71325]:   <serial>a325d973-036d-409b-af0a-cae00a2d5474</serial>
Apr 13 21:50:55 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 21:50:55 user nova-compute[71325]: </disk>
Apr 13 21:50:55 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:50:55 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Successfully detached device vdc from instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 from the persistent domain config.
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:50:55 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:50:55 user nova-compute[71325]:   <source dev="/dev/sde"/>
Apr 13 21:50:55 user nova-compute[71325]:   <target dev="vdc" bus="virtio"/>
Apr 13 21:50:55 user nova-compute[71325]:   <serial>a325d973-036d-409b-af0a-cae00a2d5474</serial>
Apr 13 21:50:55 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 21:50:55 user nova-compute[71325]: </disk>
Apr 13 21:50:55 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Cleaning up deleted instances {{(pid=71325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 21:50:55 user nova-compute[71325]: INFO nova.virt.block_device [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Booting with volume 915905d4-b167-4222-8664-66f1072c4d4d at /dev/vdc
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] There are 0 instances to clean {{(pid=71325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:50:55 user nova-compute[71325]: INFO nova.compute.manager [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] instance snapshotting
Apr 13 21:50:55 user nova-compute[71325]: DEBUG os_brick.utils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55afd39-88b2-4839-ab9c-d3d503f2ee26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-7587c8c4-a480-4db1-be69-2e60fbd6e27b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-7587c8c4-a480-4db1-be69-2e60fbd6e27b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:55 user nova-compute[71325]: WARNING nova.compute.manager [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-7587c8c4-a480-4db1-be69-2e60fbd6e27b for instance with vm_state building and task_state spawning.
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-5be52063-b3a4-42e7-ba9c-7791634309ac {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-5be52063-b3a4-42e7-ba9c-7791634309ac {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:55 user nova-compute[71325]: WARNING nova.compute.manager [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-5be52063-b3a4-42e7-ba9c-7791634309ac for instance with vm_state building and task_state spawning.
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-5be52063-b3a4-42e7-ba9c-7791634309ac {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-5be52063-b3a4-42e7-ba9c-7791634309ac {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:55 user nova-compute[71325]: WARNING nova.compute.manager [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-5be52063-b3a4-42e7-ba9c-7791634309ac for instance with vm_state building and task_state spawning.
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b707dfb-a7eb-4605-85f5-a111fffb5adc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:55 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Beginning live snapshot process
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[132a6e49-cb0f-423f-a456-b3856ec53ede]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff88b80-0172-4ae6-90da-b14681f8f41f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:50:55 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[22406b10-5ab0-48e1-a37d-38b874c0e52e]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG os_brick.utils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating existing volume attachment record: a1563bf6-7e07-4e80-a501-03b1b4cf0bf3 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681422655.91819, eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:50:55 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Successfully detached device vdc from instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 from the live domain config.
Apr 13 21:50:55 user nova-compute[71325]: INFO nova.compute.manager [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Detaching volume 5c84a9a6-d73f-46ba-b157-ba2642a6a5ae
Apr 13 21:50:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHBbsGPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:50:55 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:50:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dc149b-2771-4ff4-9a4d-501aeeb5eb6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:50:55 user nova-compute[71325]: No targets found.
Apr 13 21:50:55 user nova-compute[71325]: iSNS:
Apr 13 21:50:55 user nova-compute[71325]: No targets found.
Apr 13 21:50:55 user nova-compute[71325]: STATIC:
Apr 13 21:50:55 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6
Apr 13 21:50:55 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:55 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:55 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae
Apr 13 21:50:55 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:55 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:55 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12
Apr 13 21:50:55 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:55 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:55 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b
Apr 13 21:50:55 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:55 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:55 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3
Apr 13 21:50:55 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:55 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:55 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474
Apr 13 21:50:55 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:55 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:55 user nova-compute[71325]: FIRMWARE:
Apr 13 21:50:55 user nova-compute[71325]: No targets found.
Apr 13 21:50:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:50:55 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:50:55 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:50:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc0e914-b835-4759-86ee-c7653d364627]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: INFO nova.virt.block_device [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Attempting to driver detach volume 5c84a9a6-d73f-46ba-b157-ba2642a6a5ae from mountpoint /dev/vdb
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Attempting to detach device vdb from instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:50:56 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:50:56 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 21:50:56 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:50:56 user nova-compute[71325]:   <serial>5c84a9a6-d73f-46ba-b157-ba2642a6a5ae</serial>
Apr 13 21:50:56 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 21:50:56 user nova-compute[71325]: </disk>
Apr 13 21:50:56 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:50:56 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Successfully detached device vdb from instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 from the persistent domain config.
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:50:56 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:50:56 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 21:50:56 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:50:56 user nova-compute[71325]:   <serial>5c84a9a6-d73f-46ba-b157-ba2642a6a5ae</serial>
Apr 13 21:50:56 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 21:50:56 user nova-compute[71325]: </disk>
Apr 13 21:50:56 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0670ee7d-1357-4039-a89e-03f7436063c0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:50:56 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:50:56 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c42e5360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474'): ({'sde'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Removing single pathed devices sde {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json -f qcow2 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da52fa4-9285-426e-8fda-89bf7c0f22be]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[805d8198-b895-4ffe-b256-fe6a7b2d12ef]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Flushing IO for device /dev/sde {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3c279e-ea5a-423c-8fc3-dda238780aed]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[60198e0d-b279-4a5e-857c-1152824ce648]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] SCSI volumes sde have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json -f qcow2" returned: 0 in 0.164s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json -f qcow2 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b3bca0-d717-4532-a658-91cf9c9d02d6]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.compute.manager [req-a6ae854f-828c-4a85-8a1b-b35d68b1f4b7 req-5f824bc7-f785-4675-beaa-edee2ade554c service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-9f031ddd-e857-4075-9b14-e71dd6581d72 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a6ae854f-828c-4a85-8a1b-b35d68b1f4b7 req-5f824bc7-f785-4675-beaa-edee2ade554c service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a6ae854f-828c-4a85-8a1b-b35d68b1f4b7 req-5f824bc7-f785-4675-beaa-edee2ade554c service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a6ae854f-828c-4a85-8a1b-b35d68b1f4b7 req-5f824bc7-f785-4675-beaa-edee2ade554c service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.compute.manager [req-a6ae854f-828c-4a85-8a1b-b35d68b1f4b7 req-5f824bc7-f785-4675-beaa-edee2ade554c service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-9f031ddd-e857-4075-9b14-e71dd6581d72 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:56 user nova-compute[71325]: WARNING nova.compute.manager [req-a6ae854f-828c-4a85-8a1b-b35d68b1f4b7 req-5f824bc7-f785-4675-beaa-edee2ade554c service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-9f031ddd-e857-4075-9b14-e71dd6581d72 for instance with vm_state building and task_state spawning.
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdae8c6e-7b5c-4429-af85-0f1e78d9b0c4]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474, portal: 172.16.0.220,3260]
Apr 13 21:50:56 user nova-compute[71325]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474, portal: 172.16.0.220,3260] successful.
Apr 13 21:50:56 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422656.3860784, 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:50:56 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] VM Resumed (Lifecycle Event)
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:50:56 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Instance spawned successfully.
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a325d973-036d-409b-af0a-cae00a2d5474 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bb7b63-8a18-4556-a701-3ea232899118]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] <== disconnect_volume: return (443ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json -f qcow2" returned: 0 in 0.163s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:50:56 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422656.3894367, 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:50:56 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] VM Started (Lifecycle Event)
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf348jvyj/b5f417232f934c6b9114edd52d5a456c.delta 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681422656.503412, ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:50:56 user nova-compute[71325]: INFO nova.compute.manager [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Took 13.02 seconds to spawn the instance on the hypervisor.
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf348jvyj/b5f417232f934c6b9114edd52d5a456c.delta 1073741824" returned: 0 in 0.058s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 21:50:56 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Successfully detached device vdb from instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 from the live domain config.
Apr 13 21:50:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwMuKBIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:50:56 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f226388c-661c-4e0b-89f3-80429a2ee5cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:50:56 user nova-compute[71325]: No targets found.
Apr 13 21:50:56 user nova-compute[71325]: iSNS:
Apr 13 21:50:56 user nova-compute[71325]: No targets found.
Apr 13 21:50:56 user nova-compute[71325]: STATIC:
Apr 13 21:50:56 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6
Apr 13 21:50:56 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:56 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:56 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae
Apr 13 21:50:56 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:56 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:56 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12
Apr 13 21:50:56 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:56 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:56 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b
Apr 13 21:50:56 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:56 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:56 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3
Apr 13 21:50:56 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:50:56 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:50:56 user nova-compute[71325]: FIRMWARE:
Apr 13 21:50:56 user nova-compute[71325]: No targets found.
Apr 13 21:50:56 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:50:56 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:50:56 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eedbf2f-cbe0-41df-9ce1-0496056eeb04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[973611fb-d177-46b0-92df-15a23018e10c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:50:56 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:50:56 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:50:56 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c44d7370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5d53e0-a5c0-4dfd-af2c-1d515f1f2f0d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: INFO nova.compute.manager [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Took 29.79 seconds to build instance.
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af38563-6e10-42c8-9987-da5e0906dff1]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.910s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e8dc39-21ff-4d72-aa1f-94cea028dfa2]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e80c43-450b-493f-a668-93382864d0e6]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d82dba-977b-4b54-ad3d-6c54d51c4eb3]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b85573e-ef97-48ec-865e-224ba56eeb7c]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260]
Apr 13 21:50:56 user nova-compute[71325]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae, portal: 172.16.0.220,3260] successful.
Apr 13 21:50:56 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c84a9a6-d73f-46ba-b157-ba2642a6a5ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[908439c6-08ed-42b6-83ac-d80c0bada1c3]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] <== disconnect_volume: return (360ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'flavor' on Instance uuid eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.041s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating instance_info_cache with network_info: [{"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "address": "fa:16:3e:4c:f4:41", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e50a64-fb", "ovs_interfaceid": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "address": "fa:16:3e:ba:07:e0", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca8e06e-e9", "ovs_interfaceid": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38028ec5-f65f-44d7-a8f8-bc4470278334", "address": "fa:16:3e:f3:61:4c", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38028ec5-f6", "ovs_interfaceid": "38028ec5-f65f-44d7-a8f8-bc4470278334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Releasing lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG nova.compute.manager [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Instance network_info: |[{"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "address": "fa:16:3e:4c:f4:41", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e50a64-fb", "ovs_interfaceid": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "address": "fa:16:3e:ba:07:e0", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca8e06e-e9", "ovs_interfaceid": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38028ec5-f65f-44d7-a8f8-bc4470278334", "address": "fa:16:3e:f3:61:4c", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38028ec5-f6", "ovs_interfaceid": "38028ec5-f65f-44d7-a8f8-bc4470278334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Acquired lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG nova.network.neutron [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing network info cache for port f239b75b-16b7-4fcd-b3e3-d65f10278c43 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG nova.objects.instance [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'flavor' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.936s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:50:57 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf348jvyj/b5f417232f934c6b9114edd52d5a456c.delta /opt/stack/data/nova/instances/snapshots/tmpf348jvyj/b5f417232f934c6b9114edd52d5a456c {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b97a6da1-0643-4268-a7d9-322f0b49aafd tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b97a6da1-0643-4268-a7d9-322f0b49aafd tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.004s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b97a6da1-0643-4268-a7d9-322f0b49aafd tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b97a6da1-0643-4268-a7d9-322f0b49aafd tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71325) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.objects.instance [None req-b97a6da1-0643-4268-a7d9-322f0b49aafd tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'flavor' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf348jvyj/b5f417232f934c6b9114edd52d5a456c.delta /opt/stack/data/nova/instances/snapshots/tmpf348jvyj/b5f417232f934c6b9114edd52d5a456c" returned: 0 in 0.547s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:50:58 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Snapshot extracted, beginning image upload
Apr 13 21:50:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.network.neutron [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updated VIF entry in instance network info cache for port f239b75b-16b7-4fcd-b3e3-d65f10278c43. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.network.neutron [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating instance_info_cache with network_info: [{"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "address": "fa:16:3e:4c:f4:41", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e50a64-fb", "ovs_interfaceid": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "address": "fa:16:3e:ba:07:e0", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca8e06e-e9", "ovs_interfaceid": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38028ec5-f65f-44d7-a8f8-bc4470278334", "address": "fa:16:3e:f3:61:4c", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38028ec5-f6", "ovs_interfaceid": "38028ec5-f65f-44d7-a8f8-bc4470278334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Releasing lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:58 user nova-compute[71325]: WARNING nova.compute.manager [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 for instance with vm_state building and task_state spawning.
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:58 user nova-compute[71325]: WARNING nova.compute.manager [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 for instance with vm_state building and task_state spawning.
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-changed-38028ec5-f65f-44d7-a8f8-bc4470278334 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing instance network info cache due to event network-changed-38028ec5-f65f-44d7-a8f8-bc4470278334. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Acquiring lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Acquired lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.network.neutron [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing network info cache for port 38028ec5-f65f-44d7-a8f8-bc4470278334 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-7c0a3ffe-ff09-4154-9533-ac52698df5a9 req-5709237f-8fd8-4217-a12c-65b3d89866ae service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-vif-unplugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7c0a3ffe-ff09-4154-9533-ac52698df5a9 req-5709237f-8fd8-4217-a12c-65b3d89866ae service nova] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7c0a3ffe-ff09-4154-9533-ac52698df5a9 req-5709237f-8fd8-4217-a12c-65b3d89866ae service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7c0a3ffe-ff09-4154-9533-ac52698df5a9 req-5709237f-8fd8-4217-a12c-65b3d89866ae service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-7c0a3ffe-ff09-4154-9533-ac52698df5a9 req-5709237f-8fd8-4217-a12c-65b3d89866ae service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] No waiting events found dispatching network-vif-unplugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:50:58 user nova-compute[71325]: WARNING nova.compute.manager [req-7c0a3ffe-ff09-4154-9533-ac52698df5a9 req-5709237f-8fd8-4217-a12c-65b3d89866ae service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received unexpected event network-vif-unplugged-a70898ac-83fd-4f25-be37-aef7c87f6059 for instance with vm_state active and task_state powering-off.
Apr 13 21:50:59 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Instance destroyed successfully.
Apr 13 21:50:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b97a6da1-0643-4268-a7d9-322f0b49aafd tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:50:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b97a6da1-0643-4268-a7d9-322f0b49aafd tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.036s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:50:59 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:50:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71325) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 21:50:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:50:59 user nova-compute[71325]: DEBUG nova.network.neutron [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updated VIF entry in instance network info cache for port 38028ec5-f65f-44d7-a8f8-bc4470278334. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:50:59 user nova-compute[71325]: DEBUG nova.network.neutron [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating instance_info_cache with network_info: [{"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "address": "fa:16:3e:4c:f4:41", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e50a64-fb", "ovs_interfaceid": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "address": "fa:16:3e:ba:07:e0", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca8e06e-e9", "ovs_interfaceid": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38028ec5-f65f-44d7-a8f8-bc4470278334", "address": "fa:16:3e:f3:61:4c", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38028ec5-f6", "ovs_interfaceid": "38028ec5-f65f-44d7-a8f8-bc4470278334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:50:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Releasing lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:51:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.compute.manager [req-ffc442b8-fed6-48e3-a545-485b978fb84a req-b370b158-710e-44fe-8823-1bf05b94bc7d service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ffc442b8-fed6-48e3-a545-485b978fb84a req-b370b158-710e-44fe-8823-1bf05b94bc7d service nova] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ffc442b8-fed6-48e3-a545-485b978fb84a req-b370b158-710e-44fe-8823-1bf05b94bc7d service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ffc442b8-fed6-48e3-a545-485b978fb84a req-b370b158-710e-44fe-8823-1bf05b94bc7d service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.compute.manager [req-ffc442b8-fed6-48e3-a545-485b978fb84a req-b370b158-710e-44fe-8823-1bf05b94bc7d service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] No waiting events found dispatching network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:01 user nova-compute[71325]: WARNING nova.compute.manager [req-ffc442b8-fed6-48e3-a545-485b978fb84a req-b370b158-710e-44fe-8823-1bf05b94bc7d service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received unexpected event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 for instance with vm_state stopped and task_state None.
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.compute.manager [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:51:01 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Creating image(s)
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Ensure instance console log exists: /opt/stack/data/nova/instances/f16c661a-6f38-43fe-a801-a69de6e687ea/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Start _get_guest_xml network_info=[{"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "address": "fa:16:3e:4c:f4:41", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e50a64-fb", "ovs_interfaceid": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "address": "fa:16:3e:ba:07:e0", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca8e06e-e9", "ovs_interfaceid": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38028ec5-f65f-44d7-a8f8-bc4470278334", "address": "fa:16:3e:f3:61:4c", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38028ec5-f6", "ovs_interfaceid": "38028ec5-f65f-44d7-a8f8-bc4470278334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PlZARHQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f16c661a-6f38-43fe-a801-a69de6e687ea', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb5cba55-94c2-4da0-9227-07704d15f763', 'serial': 'fb5cba55-94c2-4da0-9227-07704d15f763'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '91310226-1ad8-476f-8cfd-977c36bd78bb', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FzEpRfIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f16c661a-6f38-43fe-a801-a69de6e687ea', 'attached_at': '', 'detached_at': '', 'volume_id': '47d1ab68-19d7-42ea-95eb-ce2536260227', 'serial': '47d1ab68-19d7-42ea-95eb-ce2536260227'}, 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '495eacd6-b61f-4ae4-8b43-71f6bbf147aa', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxYGgNku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f16c661a-6f38-43fe-a801-a69de6e687ea', 'attached_at': '', 'detached_at': '', 'volume_id': '915905d4-b167-4222-8664-66f1072c4d4d', 'serial': '915905d4-b167-4222-8664-66f1072c4d4d'}, 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': 'a1563bf6-7e07-4e80-a501-03b1b4cf0bf3', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:51:01 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:51:01 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PlZARHQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:51:01 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:51:01 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:51:01 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:01 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Snapshot image upload complete
Apr 13 21:51:01 user nova-compute[71325]: INFO nova.compute.manager [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Took 5.43 seconds to snapshot the instance on the hypervisor.
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[20447849-aa61-4872-97bc-a13b31d5a93b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:51:01 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d281b04f-1599-4d89-98dc-f0e5eebf16d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763] added
Apr 13 21:51:01 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3ace79-8883-4726-8d3b-a5bba15cbe28]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[049427a0-3f3c-4378-b5f2-2f6d5231b68a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PlZARHQX {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PlZARHQX" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[646cdaac-eea9-417d-be97-d27c15d7b3e6]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PlZARHQX'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa04bbd-e2c1-4a00-a9a8-682ff2ae535d]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ee8fb1-6d16-4a61-ad95-d95f58c29185]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:51:01 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:51:01 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:51:01 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:51:01 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:51:01 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:51:01 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:51:01 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:51:01 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eee93e-bd6d-4f82-890b-45513c01b7e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763, portal: 172.16.0.220,3260]
Apr 13 21:51:01 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763, portal: 172.16.0.220,3260] successful.
Apr 13 21:51:01 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9539a30-eebb-430b-9971-08b6ffd54eef]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f25c98b-c4e8-4288-b158-935db3893ae9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:51:01 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:51:01 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:51:01 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:51:01 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:51:01 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:51:01 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:51:01 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:51:01 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:51:01 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:51:01 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d54b8af-8071-41f2-ab43-fa747d6d3b15]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:51:01 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PlZARHQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26236666539366362', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236666539366362', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FzEpRfIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:51:02 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:51:02 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:51:02 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ef9427-1e3e-41d1-9b46-e1e7347b3eb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:51:02 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6e1125-c24e-4bfc-9948-edd3e3293993]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227] added
Apr 13 21:51:02 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[237dc241-8e43-4473-ba5d-794d1b766b00]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70cbcb6-762b-4cf3-b391-cd1202814c30]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FzEpRfIB {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FzEpRfIB" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ce7775-3702-47e9-bd04-a81607b16014]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FzEpRfIB'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2760dc-b056-47c2-9550-7fb508014eef]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b72df5-3850-4918-ad85-60301fdfbf68]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d79660-0582-4523-87fb-4ee6d2a8cf55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227, portal: 172.16.0.220,3260]
Apr 13 21:51:02 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227, portal: 172.16.0.220,3260] successful.
Apr 13 21:51:02 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14729a0-ba93-4380-9d35-93bbc58e61c0]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fc1849-f673-4b89-baf6-e9b38d47545f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:51:02 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[752182f4-43bb-499d-bfd9-41e977f450a2]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: None {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FzEpRfIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '26161663131306161', 'path': '/dev/sde'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:51:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161663131306161', 'path': '/dev/sde'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxYGgNku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:51:04 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:51:04 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:51:04 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[80af6a5d-cc56-4f17-9578-5aabbe51cf01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:51:04 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.415s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adfa52d-13a8-4ce5-9e6c-5b921f19cbfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d] added
Apr 13 21:51:04 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[242d5ea7-7b60-40b5-8697-2ddd5c41f9f7]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f1995c-7a22-4d0e-a085-8ee3208d8fdc]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxYGgNku {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxYGgNku" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eac4038-ef89-4b44-94a4-c036f057e268]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yxYGgNku'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cd2df2-90fa-42c1-8b95-a86e78cacbbb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[52781ac1-c097-407d-a228-b48d22756e1e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25a168e-658a-4c2c-b50b-ff69f874bb89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d, portal: 172.16.0.220,3260]
Apr 13 21:51:04 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d, portal: 172.16.0.220,3260] successful.
Apr 13 21:51:04 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff0a026-3d1a-44e5-ad50-adefb3303909]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[de41d739-3726-4115-9851-0d6109b4cd64]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:51:04 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:51:04 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:51:04 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.744s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] HCTL ('39', '-', '-', 0) found on session 20 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[28da8206-06c1-476f-b531-72793f51034b]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxYGgNku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:04 user nova-compute[71325]: INFO nova.compute.manager [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Unrescuing
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquired lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:51:04 user nova-compute[71325]: DEBUG nova.network.neutron [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updating instance_info_cache with network_info: [{"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Releasing lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG nova.objects.instance [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'flavor' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.813s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] <== connect_volume: return (1817ms) {'type': 'block', 'scsi_wwn': '26334333564653366', 'path': '/dev/sdh'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334333564653366', 'path': '/dev/sdh'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-c0717705-44a6-495a-a41f-3b83233c39af req-05c10357-a7bb-498c-884a-3431caff6904 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-changed-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-c0717705-44a6-495a-a41f-3b83233c39af req-05c10357-a7bb-498c-884a-3431caff6904 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Refreshing instance network info cache due to event network-changed-f0a7bc69-be17-49d2-94fc-40541afce8ed. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c0717705-44a6-495a-a41f-3b83233c39af req-05c10357-a7bb-498c-884a-3431caff6904 service nova] Acquiring lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c0717705-44a6-495a-a41f-3b83233c39af req-05c10357-a7bb-498c-884a-3431caff6904 service nova] Acquired lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG nova.network.neutron [req-c0717705-44a6-495a-a41f-3b83233c39af req-05c10357-a7bb-498c-884a-3431caff6904 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Refreshing network info cache for port f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.compute.manager [req-696e5e80-d6de-4bde-a1c3-edc741f16400 req-38517703-34c2-45f7-872d-979654584e5e service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-vif-unplugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-696e5e80-d6de-4bde-a1c3-edc741f16400 req-38517703-34c2-45f7-872d-979654584e5e service nova] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-696e5e80-d6de-4bde-a1c3-edc741f16400 req-38517703-34c2-45f7-872d-979654584e5e service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-696e5e80-d6de-4bde-a1c3-edc741f16400 req-38517703-34c2-45f7-872d-979654584e5e service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.compute.manager [req-696e5e80-d6de-4bde-a1c3-edc741f16400 req-38517703-34c2-45f7-872d-979654584e5e service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] No waiting events found dispatching network-vif-unplugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:06 user nova-compute[71325]: WARNING nova.compute.manager [req-696e5e80-d6de-4bde-a1c3-edc741f16400 req-38517703-34c2-45f7-872d-979654584e5e service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received unexpected event network-vif-unplugged-f0a7bc69-be17-49d2-94fc-40541afce8ed for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c6:3b,bridge_name='br-int',has_traffic_filtering=True,id=2ade8fab-1fde-4730-aacc-fcb3b613c402,network=Network(912df412-2f07-4668-8db3-bbcfced5fb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ade8fab-1f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:3c:03,bridge_name='br-int',has_traffic_filtering=True,id=079a7af6-43b0-4f03-a24a-b54d0e9a1c89,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap079a7af6-43') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:91:74,bridge_name='br-int',has_traffic_filtering=True,id=7062c9f1-5719-4d6b-8b6a-efbb377c078b,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7062c9f1-57') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "address": "fa:16:3e:4c:f4:41", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e50a64-fb", "ovs_interfaceid": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "address": "fa:16:3e:4c:f4:41", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e50a64-fb", "ovs_interfaceid": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:41,bridge_name='br-int',has_traffic_filtering=True,id=75e50a64-fb53-4613-b7b5-3cc00b4b9458,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e50a64-fb') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "address": "fa:16:3e:ba:07:e0", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca8e06e-e9", "ovs_interfaceid": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "address": "fa:16:3e:ba:07:e0", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca8e06e-e9", "ovs_interfaceid": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:07:e0,bridge_name='br-int',has_traffic_filtering=True,id=0ca8e06e-e964-4815-b2d8-a6c3fef7bf75,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca8e06e-e9') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ee:a8,bridge_name='br-int',has_traffic_filtering=True,id=f239b75b-16b7-4fcd-b3e3-d65f10278c43,network=Network(b0bd1140-dadc-4c14-940a-3b35313e6e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf239b75b-16') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38028ec5-f65f-44d7-a8f8-bc4470278334", "address": "fa:16:3e:f3:61:4c", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38028ec5-f6", "ovs_interfaceid": "38028ec5-f65f-44d7-a8f8-bc4470278334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "38028ec5-f65f-44d7-a8f8-bc4470278334", "address": "fa:16:3e:f3:61:4c", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38028ec5-f6", "ovs_interfaceid": "38028ec5-f65f-44d7-a8f8-bc4470278334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:61:4c,bridge_name='br-int',has_traffic_filtering=True,id=38028ec5-f65f-44d7-a8f8-bc4470278334,network=Network(b0bd1140-dadc-4c14-940a-3b35313e6e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38028ec5-f6') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.objects.instance [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lazy-loading 'pci_devices' on Instance uuid f16c661a-6f38-43fe-a801-a69de6e687ea {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:51:06 user nova-compute[71325]:   <uuid>f16c661a-6f38-43fe-a801-a69de6e687ea</uuid>
Apr 13 21:51:06 user nova-compute[71325]:   <name>instance-00000012</name>
Apr 13 21:51:06 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:51:06 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:51:06 user nova-compute[71325]:   <metadata>
Apr 13 21:51:06 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:51:06 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:51:06 user nova-compute[71325]:       <nova:name>tempest-device-tagging-server-535284063</nova:name>
Apr 13 21:51:06 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:51:01</nova:creationTime>
Apr 13 21:51:06 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:51:06 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:51:06 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:51:06 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:51:06 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:51:06 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:51:06 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:51:06 user nova-compute[71325]:       <nova:owner>
Apr 13 21:51:06 user nova-compute[71325]:         <nova:user uuid="2446d7b79d7f4879ab857ab6a10777aa">tempest-TaggedBootDevicesTest-1783658683-project-member</nova:user>
Apr 13 21:51:06 user nova-compute[71325]:         <nova:project uuid="1f969510e1734ad4bf48a8c0a3d7ae8f">tempest-TaggedBootDevicesTest-1783658683</nova:project>
Apr 13 21:51:06 user nova-compute[71325]:       </nova:owner>
Apr 13 21:51:06 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:51:06 user nova-compute[71325]:       <nova:ports>
Apr 13 21:51:06 user nova-compute[71325]:         <nova:port uuid="2ade8fab-1fde-4730-aacc-fcb3b613c402">
Apr 13 21:51:06 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 21:51:06 user nova-compute[71325]:         </nova:port>
Apr 13 21:51:06 user nova-compute[71325]:         <nova:port uuid="079a7af6-43b0-4f03-a24a-b54d0e9a1c89">
Apr 13 21:51:06 user nova-compute[71325]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
Apr 13 21:51:06 user nova-compute[71325]:         </nova:port>
Apr 13 21:51:06 user nova-compute[71325]:         <nova:port uuid="7062c9f1-5719-4d6b-8b6a-efbb377c078b">
Apr 13 21:51:06 user nova-compute[71325]:           <nova:ip type="fixed" address="10.1.1.230" ipVersion="4"/>
Apr 13 21:51:06 user nova-compute[71325]:         </nova:port>
Apr 13 21:51:06 user nova-compute[71325]:         <nova:port uuid="75e50a64-fb53-4613-b7b5-3cc00b4b9458">
Apr 13 21:51:06 user nova-compute[71325]:           <nova:ip type="fixed" address="10.1.1.75" ipVersion="4"/>
Apr 13 21:51:06 user nova-compute[71325]:         </nova:port>
Apr 13 21:51:06 user nova-compute[71325]:         <nova:port uuid="0ca8e06e-e964-4815-b2d8-a6c3fef7bf75">
Apr 13 21:51:06 user nova-compute[71325]:           <nova:ip type="fixed" address="10.1.1.214" ipVersion="4"/>
Apr 13 21:51:06 user nova-compute[71325]:         </nova:port>
Apr 13 21:51:06 user nova-compute[71325]:         <nova:port uuid="f239b75b-16b7-4fcd-b3e3-d65f10278c43">
Apr 13 21:51:06 user nova-compute[71325]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 13 21:51:06 user nova-compute[71325]:         </nova:port>
Apr 13 21:51:06 user nova-compute[71325]:         <nova:port uuid="38028ec5-f65f-44d7-a8f8-bc4470278334">
Apr 13 21:51:06 user nova-compute[71325]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 13 21:51:06 user nova-compute[71325]:         </nova:port>
Apr 13 21:51:06 user nova-compute[71325]:       </nova:ports>
Apr 13 21:51:06 user nova-compute[71325]:     </nova:instance>
Apr 13 21:51:06 user nova-compute[71325]:   </metadata>
Apr 13 21:51:06 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:51:06 user nova-compute[71325]:     <system>
Apr 13 21:51:06 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:51:06 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:51:06 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:51:06 user nova-compute[71325]:       <entry name="serial">f16c661a-6f38-43fe-a801-a69de6e687ea</entry>
Apr 13 21:51:06 user nova-compute[71325]:       <entry name="uuid">f16c661a-6f38-43fe-a801-a69de6e687ea</entry>
Apr 13 21:51:06 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:51:06 user nova-compute[71325]:     </system>
Apr 13 21:51:06 user nova-compute[71325]:   </sysinfo>
Apr 13 21:51:06 user nova-compute[71325]:   <os>
Apr 13 21:51:06 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:51:06 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:51:06 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:51:06 user nova-compute[71325]:   </os>
Apr 13 21:51:06 user nova-compute[71325]:   <features>
Apr 13 21:51:06 user nova-compute[71325]:     <acpi/>
Apr 13 21:51:06 user nova-compute[71325]:     <apic/>
Apr 13 21:51:06 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:51:06 user nova-compute[71325]:   </features>
Apr 13 21:51:06 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:51:06 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:51:06 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:51:06 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:51:06 user nova-compute[71325]:   </clock>
Apr 13 21:51:06 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:51:06 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:51:06 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:51:06 user nova-compute[71325]:   </cpu>
Apr 13 21:51:06 user nova-compute[71325]:   <devices>
Apr 13 21:51:06 user nova-compute[71325]:     <disk type="file" device="cdrom">
Apr 13 21:51:06 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 21:51:06 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/f16c661a-6f38-43fe-a801-a69de6e687ea/disk.config"/>
Apr 13 21:51:06 user nova-compute[71325]:       <target dev="hda" bus="ide"/>
Apr 13 21:51:06 user nova-compute[71325]:     </disk>
Apr 13 21:51:06 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:51:06 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:51:06 user nova-compute[71325]:       <source dev="/dev/sdb"/>
Apr 13 21:51:06 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:51:06 user nova-compute[71325]:       <serial>fb5cba55-94c2-4da0-9227-07704d15f763</serial>
Apr 13 21:51:06 user nova-compute[71325]:     </disk>
Apr 13 21:51:06 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:51:06 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:51:06 user nova-compute[71325]:       <source dev="/dev/sde"/>
Apr 13 21:51:06 user nova-compute[71325]:       <target dev="vdb" bus="virtio"/>
Apr 13 21:51:06 user nova-compute[71325]:       <serial>47d1ab68-19d7-42ea-95eb-ce2536260227</serial>
Apr 13 21:51:06 user nova-compute[71325]:     </disk>
Apr 13 21:51:06 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:51:06 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:51:06 user nova-compute[71325]:       <source dev="/dev/sdh"/>
Apr 13 21:51:06 user nova-compute[71325]:       <target dev="vdc" bus="virtio"/>
Apr 13 21:51:06 user nova-compute[71325]:       <serial>915905d4-b167-4222-8664-66f1072c4d4d</serial>
Apr 13 21:51:06 user nova-compute[71325]:     </disk>
Apr 13 21:51:06 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:51:06 user nova-compute[71325]:       <mac address="fa:16:3e:4c:c6:3b"/>
Apr 13 21:51:06 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:51:06 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:51:06 user nova-compute[71325]:       <target dev="tap2ade8fab-1f"/>
Apr 13 21:51:06 user nova-compute[71325]:     </interface>
Apr 13 21:51:06 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:51:06 user nova-compute[71325]:       <mac address="fa:16:3e:ab:3c:03"/>
Apr 13 21:51:06 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:51:06 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:51:06 user nova-compute[71325]:       <target dev="tap079a7af6-43"/>
Apr 13 21:51:06 user nova-compute[71325]:     </interface>
Apr 13 21:51:06 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:51:06 user nova-compute[71325]:       <mac address="fa:16:3e:60:91:74"/>
Apr 13 21:51:06 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:51:06 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:51:06 user nova-compute[71325]:       <target dev="tap7062c9f1-57"/>
Apr 13 21:51:06 user nova-compute[71325]:     </interface>
Apr 13 21:51:06 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:51:06 user nova-compute[71325]:       <mac address="fa:16:3e:4c:f4:41"/>
Apr 13 21:51:06 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:51:06 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:51:06 user nova-compute[71325]:       <target dev="tap75e50a64-fb"/>
Apr 13 21:51:06 user nova-compute[71325]:     </interface>
Apr 13 21:51:06 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:51:06 user nova-compute[71325]:       <mac address="fa:16:3e:ba:07:e0"/>
Apr 13 21:51:06 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:51:06 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:51:06 user nova-compute[71325]:       <target dev="tap0ca8e06e-e9"/>
Apr 13 21:51:06 user nova-compute[71325]:     </interface>
Apr 13 21:51:06 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:51:06 user nova-compute[71325]:       <mac address="fa:16:3e:7b:ee:a8"/>
Apr 13 21:51:06 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:51:06 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:51:06 user nova-compute[71325]:       <target dev="tapf239b75b-16"/>
Apr 13 21:51:06 user nova-compute[71325]:     </interface>
Apr 13 21:51:06 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:51:06 user nova-compute[71325]:       <mac address="fa:16:3e:f3:61:4c"/>
Apr 13 21:51:06 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:51:06 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:51:06 user nova-compute[71325]:       <target dev="tap38028ec5-f6"/>
Apr 13 21:51:06 user nova-compute[71325]:     </interface>
Apr 13 21:51:06 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:51:06 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/f16c661a-6f38-43fe-a801-a69de6e687ea/console.log" append="off"/>
Apr 13 21:51:06 user nova-compute[71325]:     </serial>
Apr 13 21:51:06 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:51:06 user nova-compute[71325]:     <video>
Apr 13 21:51:06 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:51:06 user nova-compute[71325]:     </video>
Apr 13 21:51:06 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:51:06 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:51:06 user nova-compute[71325]:     </rng>
Apr 13 21:51:06 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:51:06 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:51:06 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:51:06 user nova-compute[71325]:     </memballoon>
Apr 13 21:51:06 user nova-compute[71325]:   </devices>
Apr 13 21:51:06 user nova-compute[71325]: </domain>
Apr 13 21:51:06 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c6:3b,bridge_name='br-int',has_traffic_filtering=True,id=2ade8fab-1fde-4730-aacc-fcb3b613c402,network=Network(912df412-2f07-4668-8db3-bbcfced5fb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ade8fab-1f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG os_vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c6:3b,bridge_name='br-int',has_traffic_filtering=True,id=2ade8fab-1fde-4730-aacc-fcb3b613c402,network=Network(912df412-2f07-4668-8db3-bbcfced5fb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ade8fab-1f') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ade8fab-1f, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ade8fab-1f, col_values=(('external_ids', {'iface-id': '2ade8fab-1fde-4730-aacc-fcb3b613c402', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:c6:3b', 'vm-uuid': 'f16c661a-6f38-43fe-a801-a69de6e687ea'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: INFO os_vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c6:3b,bridge_name='br-int',has_traffic_filtering=True,id=2ade8fab-1fde-4730-aacc-fcb3b613c402,network=Network(912df412-2f07-4668-8db3-bbcfced5fb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ade8fab-1f')
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:3c:03,bridge_name='br-int',has_traffic_filtering=True,id=079a7af6-43b0-4f03-a24a-b54d0e9a1c89,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap079a7af6-43') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG os_vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:3c:03,bridge_name='br-int',has_traffic_filtering=True,id=079a7af6-43b0-4f03-a24a-b54d0e9a1c89,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap079a7af6-43') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap079a7af6-43, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap079a7af6-43, col_values=(('external_ids', {'iface-id': '079a7af6-43b0-4f03-a24a-b54d0e9a1c89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:3c:03', 'vm-uuid': 'f16c661a-6f38-43fe-a801-a69de6e687ea'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: INFO os_vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:3c:03,bridge_name='br-int',has_traffic_filtering=True,id=079a7af6-43b0-4f03-a24a-b54d0e9a1c89,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap079a7af6-43')
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:91:74,bridge_name='br-int',has_traffic_filtering=True,id=7062c9f1-5719-4d6b-8b6a-efbb377c078b,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7062c9f1-57') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG os_vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:91:74,bridge_name='br-int',has_traffic_filtering=True,id=7062c9f1-5719-4d6b-8b6a-efbb377c078b,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7062c9f1-57') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7062c9f1-57, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7062c9f1-57, col_values=(('external_ids', {'iface-id': '7062c9f1-5719-4d6b-8b6a-efbb377c078b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:91:74', 'vm-uuid': 'f16c661a-6f38-43fe-a801-a69de6e687ea'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: INFO os_vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:91:74,bridge_name='br-int',has_traffic_filtering=True,id=7062c9f1-5719-4d6b-8b6a-efbb377c078b,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7062c9f1-57')
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "address": "fa:16:3e:4c:f4:41", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e50a64-fb", "ovs_interfaceid": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "address": "fa:16:3e:4c:f4:41", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e50a64-fb", "ovs_interfaceid": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:41,bridge_name='br-int',has_traffic_filtering=True,id=75e50a64-fb53-4613-b7b5-3cc00b4b9458,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e50a64-fb') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG os_vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:41,bridge_name='br-int',has_traffic_filtering=True,id=75e50a64-fb53-4613-b7b5-3cc00b4b9458,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e50a64-fb') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75e50a64-fb, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75e50a64-fb, col_values=(('external_ids', {'iface-id': '75e50a64-fb53-4613-b7b5-3cc00b4b9458', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:f4:41', 'vm-uuid': 'f16c661a-6f38-43fe-a801-a69de6e687ea'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: INFO os_vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:41,bridge_name='br-int',has_traffic_filtering=True,id=75e50a64-fb53-4613-b7b5-3cc00b4b9458,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e50a64-fb')
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "address": "fa:16:3e:ba:07:e0", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca8e06e-e9", "ovs_interfaceid": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "address": "fa:16:3e:ba:07:e0", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca8e06e-e9", "ovs_interfaceid": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:07:e0,bridge_name='br-int',has_traffic_filtering=True,id=0ca8e06e-e964-4815-b2d8-a6c3fef7bf75,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca8e06e-e9') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG os_vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:07:e0,bridge_name='br-int',has_traffic_filtering=True,id=0ca8e06e-e964-4815-b2d8-a6c3fef7bf75,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca8e06e-e9') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ca8e06e-e9, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ca8e06e-e9, col_values=(('external_ids', {'iface-id': '0ca8e06e-e964-4815-b2d8-a6c3fef7bf75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:07:e0', 'vm-uuid': 'f16c661a-6f38-43fe-a801-a69de6e687ea'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:06 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Instance destroyed successfully.
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: INFO os_vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:07:e0,bridge_name='br-int',has_traffic_filtering=True,id=0ca8e06e-e964-4815-b2d8-a6c3fef7bf75,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca8e06e-e9')
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ee:a8,bridge_name='br-int',has_traffic_filtering=True,id=f239b75b-16b7-4fcd-b3e3-d65f10278c43,network=Network(b0bd1140-dadc-4c14-940a-3b35313e6e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf239b75b-16') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG os_vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ee:a8,bridge_name='br-int',has_traffic_filtering=True,id=f239b75b-16b7-4fcd-b3e3-d65f10278c43,network=Network(b0bd1140-dadc-4c14-940a-3b35313e6e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf239b75b-16') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf239b75b-16, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf239b75b-16, col_values=(('external_ids', {'iface-id': 'f239b75b-16b7-4fcd-b3e3-d65f10278c43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:ee:a8', 'vm-uuid': 'f16c661a-6f38-43fe-a801-a69de6e687ea'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.neutron [req-c0717705-44a6-495a-a41f-3b83233c39af req-05c10357-a7bb-498c-884a-3431caff6904 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updated VIF entry in instance network info cache for port f0a7bc69-be17-49d2-94fc-40541afce8ed. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.neutron [req-c0717705-44a6-495a-a41f-3b83233c39af req-05c10357-a7bb-498c-884a-3431caff6904 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updating instance_info_cache with network_info: [{"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c0717705-44a6-495a-a41f-3b83233c39af req-05c10357-a7bb-498c-884a-3431caff6904 service nova] Releasing lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: INFO os_vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ee:a8,bridge_name='br-int',has_traffic_filtering=True,id=f239b75b-16b7-4fcd-b3e3-d65f10278c43,network=Network(b0bd1140-dadc-4c14-940a-3b35313e6e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf239b75b-16')
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38028ec5-f65f-44d7-a8f8-bc4470278334", "address": "fa:16:3e:f3:61:4c", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38028ec5-f6", "ovs_interfaceid": "38028ec5-f65f-44d7-a8f8-bc4470278334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "38028ec5-f65f-44d7-a8f8-bc4470278334", "address": "fa:16:3e:f3:61:4c", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38028ec5-f6", "ovs_interfaceid": "38028ec5-f65f-44d7-a8f8-bc4470278334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:61:4c,bridge_name='br-int',has_traffic_filtering=True,id=38028ec5-f65f-44d7-a8f8-bc4470278334,network=Network(b0bd1140-dadc-4c14-940a-3b35313e6e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38028ec5-f6') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG os_vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:61:4c,bridge_name='br-int',has_traffic_filtering=True,id=38028ec5-f65f-44d7-a8f8-bc4470278334,network=Network(b0bd1140-dadc-4c14-940a-3b35313e6e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38028ec5-f6') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38028ec5-f6, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38028ec5-f6, col_values=(('external_ids', {'iface-id': '38028ec5-f65f-44d7-a8f8-bc4470278334', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:61:4c', 'vm-uuid': 'f16c661a-6f38-43fe-a801-a69de6e687ea'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:06 user nova-compute[71325]: INFO os_vif [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:61:4c,bridge_name='br-int',has_traffic_filtering=True,id=38028ec5-f65f-44d7-a8f8-bc4470278334,network=Network(b0bd1140-dadc-4c14-940a-3b35313e6e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38028ec5-f6')
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] No BDM found with device name hda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] No VIF found with MAC fa:16:3e:4c:c6:3b, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] No VIF found with MAC fa:16:3e:ba:07:e0, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:51:06 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Using config drive
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:07 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Creating config drive at /opt/stack/data/nova/instances/f16c661a-6f38-43fe-a801-a69de6e687ea/disk.config
Apr 13 21:51:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f16c661a-6f38-43fe-a801-a69de6e687ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr0rjnh2w {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f16c661a-6f38-43fe-a801-a69de6e687ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr0rjnh2w" returned: 0 in 0.055s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for af4efbd5-a4c1-4e7c-b274-92413f86f2a8 due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422672.6949553, af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:51:12 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] VM Resumed (Lifecycle Event)
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-704d7622-0aae-4361-aef2-964897540c13 req-b07adbd6-a119-44c4-8eef-53f61118f047 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-changed-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-704d7622-0aae-4361-aef2-964897540c13 req-b07adbd6-a119-44c4-8eef-53f61118f047 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Refreshing instance network info cache due to event network-changed-f0a7bc69-be17-49d2-94fc-40541afce8ed. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-704d7622-0aae-4361-aef2-964897540c13 req-b07adbd6-a119-44c4-8eef-53f61118f047 service nova] Acquiring lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-704d7622-0aae-4361-aef2-964897540c13 req-b07adbd6-a119-44c4-8eef-53f61118f047 service nova] Acquired lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.network.neutron [req-704d7622-0aae-4361-aef2-964897540c13 req-b07adbd6-a119-44c4-8eef-53f61118f047 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Refreshing network info cache for port f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-b76fb706-45e8-48a2-83cf-ab57eb2aeddc req-5da93c69-1bc2-4b8c-a4bf-a3b439f8b853 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b76fb706-45e8-48a2-83cf-ab57eb2aeddc req-5da93c69-1bc2-4b8c-a4bf-a3b439f8b853 service nova] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b76fb706-45e8-48a2-83cf-ab57eb2aeddc req-5da93c69-1bc2-4b8c-a4bf-a3b439f8b853 service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b76fb706-45e8-48a2-83cf-ab57eb2aeddc req-5da93c69-1bc2-4b8c-a4bf-a3b439f8b853 service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-b76fb706-45e8-48a2-83cf-ab57eb2aeddc req-5da93c69-1bc2-4b8c-a4bf-a3b439f8b853 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] No waiting events found dispatching network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.compute.manager [req-b76fb706-45e8-48a2-83cf-ab57eb2aeddc req-5da93c69-1bc2-4b8c-a4bf-a3b439f8b853 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received unexpected event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-670203b4-64f0-4a99-b5e0-c9d7ba67a97a req-f4af802a-7596-494d-aea3-9daa4c635ca0 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-670203b4-64f0-4a99-b5e0-c9d7ba67a97a req-f4af802a-7596-494d-aea3-9daa4c635ca0 service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-670203b4-64f0-4a99-b5e0-c9d7ba67a97a req-f4af802a-7596-494d-aea3-9daa4c635ca0 service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-670203b4-64f0-4a99-b5e0-c9d7ba67a97a req-f4af802a-7596-494d-aea3-9daa4c635ca0 service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-670203b4-64f0-4a99-b5e0-c9d7ba67a97a req-f4af802a-7596-494d-aea3-9daa4c635ca0 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.compute.manager [req-670203b4-64f0-4a99-b5e0-c9d7ba67a97a req-f4af802a-7596-494d-aea3-9daa4c635ca0 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-2ade8fab-1fde-4730-aacc-fcb3b613c402 for instance with vm_state building and task_state spawning.
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] No waiting events found dispatching network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.compute.manager [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received unexpected event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] No waiting events found dispatching network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.compute.manager [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received unexpected event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-06bcc9e7-4179-4644-858d-8bdf74334d76 req-b42f69ca-b99f-444e-9fb6-e68fa9384354 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-75e50a64-fb53-4613-b7b5-3cc00b4b9458 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-06bcc9e7-4179-4644-858d-8bdf74334d76 req-b42f69ca-b99f-444e-9fb6-e68fa9384354 service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-06bcc9e7-4179-4644-858d-8bdf74334d76 req-b42f69ca-b99f-444e-9fb6-e68fa9384354 service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-06bcc9e7-4179-4644-858d-8bdf74334d76 req-b42f69ca-b99f-444e-9fb6-e68fa9384354 service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-06bcc9e7-4179-4644-858d-8bdf74334d76 req-b42f69ca-b99f-444e-9fb6-e68fa9384354 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-75e50a64-fb53-4613-b7b5-3cc00b4b9458 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.compute.manager [req-06bcc9e7-4179-4644-858d-8bdf74334d76 req-b42f69ca-b99f-444e-9fb6-e68fa9384354 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-75e50a64-fb53-4613-b7b5-3cc00b4b9458 for instance with vm_state building and task_state spawning.
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-2ade8fab-1fde-4730-aacc-fcb3b613c402 for instance with vm_state building and task_state spawning.
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-079a7af6-43b0-4f03-a24a-b54d0e9a1c89 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-079a7af6-43b0-4f03-a24a-b54d0e9a1c89 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-079a7af6-43b0-4f03-a24a-b54d0e9a1c89 for instance with vm_state building and task_state spawning.
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-079a7af6-43b0-4f03-a24a-b54d0e9a1c89 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-079a7af6-43b0-4f03-a24a-b54d0e9a1c89 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-079a7af6-43b0-4f03-a24a-b54d0e9a1c89 for instance with vm_state building and task_state spawning.
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-7062c9f1-5719-4d6b-8b6a-efbb377c078b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-7062c9f1-5719-4d6b-8b6a-efbb377c078b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-7062c9f1-5719-4d6b-8b6a-efbb377c078b for instance with vm_state building and task_state spawning.
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-7062c9f1-5719-4d6b-8b6a-efbb377c078b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-7062c9f1-5719-4d6b-8b6a-efbb377c078b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-7062c9f1-5719-4d6b-8b6a-efbb377c078b for instance with vm_state building and task_state spawning.
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 for instance with vm_state building and task_state spawning.
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 for instance with vm_state building and task_state spawning.
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-f239b75b-16b7-4fcd-b3e3-d65f10278c43 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-f239b75b-16b7-4fcd-b3e3-d65f10278c43 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.compute.manager [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-f239b75b-16b7-4fcd-b3e3-d65f10278c43 for instance with vm_state building and task_state spawning.
Apr 13 21:51:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:51:12 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7536MB free_disk=26.21735382080078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422672.6956916, af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:51:12 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] VM Started (Lifecycle Event)
Apr 13 21:51:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance be81f393-654b-4b50-856e-00818f3ae59e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance fe05a421-ee64-492b-a338-0e864458908c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f16c661a-6f38-43fe-a801-a69de6e687ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.manager [req-313bbebf-9c8e-43ba-9757-fc05a04a39cc req-adbe9721-e140-4da3-86ea-dd93609687dc service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-75e50a64-fb53-4613-b7b5-3cc00b4b9458 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-313bbebf-9c8e-43ba-9757-fc05a04a39cc req-adbe9721-e140-4da3-86ea-dd93609687dc service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-313bbebf-9c8e-43ba-9757-fc05a04a39cc req-adbe9721-e140-4da3-86ea-dd93609687dc service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-313bbebf-9c8e-43ba-9757-fc05a04a39cc req-adbe9721-e140-4da3-86ea-dd93609687dc service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.manager [req-313bbebf-9c8e-43ba-9757-fc05a04a39cc req-adbe9721-e140-4da3-86ea-dd93609687dc service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-75e50a64-fb53-4613-b7b5-3cc00b4b9458 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:13 user nova-compute[71325]: WARNING nova.compute.manager [req-313bbebf-9c8e-43ba-9757-fc05a04a39cc req-adbe9721-e140-4da3-86ea-dd93609687dc service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-75e50a64-fb53-4613-b7b5-3cc00b4b9458 for instance with vm_state building and task_state spawning.
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.network.neutron [req-704d7622-0aae-4361-aef2-964897540c13 req-b07adbd6-a119-44c4-8eef-53f61118f047 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updated VIF entry in instance network info cache for port f0a7bc69-be17-49d2-94fc-40541afce8ed. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.network.neutron [req-704d7622-0aae-4361-aef2-964897540c13 req-b07adbd6-a119-44c4-8eef-53f61118f047 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updating instance_info_cache with network_info: [{"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-704d7622-0aae-4361-aef2-964897540c13 req-b07adbd6-a119-44c4-8eef-53f61118f047 service nova] Releasing lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-f239b75b-16b7-4fcd-b3e3-d65f10278c43 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-f239b75b-16b7-4fcd-b3e3-d65f10278c43 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:14 user nova-compute[71325]: WARNING nova.compute.manager [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-f239b75b-16b7-4fcd-b3e3-d65f10278c43 for instance with vm_state building and task_state spawning.
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-38028ec5-f65f-44d7-a8f8-bc4470278334 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-38028ec5-f65f-44d7-a8f8-bc4470278334 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:14 user nova-compute[71325]: WARNING nova.compute.manager [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-38028ec5-f65f-44d7-a8f8-bc4470278334 for instance with vm_state building and task_state spawning.
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-38028ec5-f65f-44d7-a8f8-bc4470278334 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-38028ec5-f65f-44d7-a8f8-bc4470278334 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:14 user nova-compute[71325]: WARNING nova.compute.manager [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-38028ec5-f65f-44d7-a8f8-bc4470278334 for instance with vm_state building and task_state spawning.
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422659.2843337, ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:51:14 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] VM Stopped (Lifecycle Event)
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422674.299336, f16c661a-6f38-43fe-a801-a69de6e687ea => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:51:14 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] VM Resumed (Lifecycle Event)
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-65f689ae-c80e-4bdc-8798-3916d879494d None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-65f689ae-c80e-4bdc-8798-3916d879494d None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:51:14 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Instance spawned successfully.
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:51:14 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422674.3028853, f16c661a-6f38-43fe-a801-a69de6e687ea => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:51:14 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] VM Started (Lifecycle Event)
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:51:14 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:51:14 user nova-compute[71325]: INFO nova.compute.manager [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Took 13.36 seconds to spawn the instance on the hypervisor.
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:51:14 user nova-compute[71325]: INFO nova.compute.manager [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Took 30.05 seconds to build instance.
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.162s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:51:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updating instance_info_cache with network_info: [{"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:51:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-af4efbd5-a4c1-4e7c-b274-92413f86f2a8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:51:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:51:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:51:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:51:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:51:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:51:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "be81f393-654b-4b50-856e-00818f3ae59e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "be81f393-654b-4b50-856e-00818f3ae59e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "be81f393-654b-4b50-856e-00818f3ae59e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "be81f393-654b-4b50-856e-00818f3ae59e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "be81f393-654b-4b50-856e-00818f3ae59e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:25 user nova-compute[71325]: INFO nova.compute.manager [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Terminating instance
Apr 13 21:51:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG nova.compute.manager [req-213cf456-b10a-4237-8acd-981e946ecdd7 req-c5849cee-e3cc-44ce-8507-cd7832513602 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Received event network-vif-unplugged-c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-213cf456-b10a-4237-8acd-981e946ecdd7 req-c5849cee-e3cc-44ce-8507-cd7832513602 service nova] Acquiring lock "be81f393-654b-4b50-856e-00818f3ae59e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-213cf456-b10a-4237-8acd-981e946ecdd7 req-c5849cee-e3cc-44ce-8507-cd7832513602 service nova] Lock "be81f393-654b-4b50-856e-00818f3ae59e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-213cf456-b10a-4237-8acd-981e946ecdd7 req-c5849cee-e3cc-44ce-8507-cd7832513602 service nova] Lock "be81f393-654b-4b50-856e-00818f3ae59e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG nova.compute.manager [req-213cf456-b10a-4237-8acd-981e946ecdd7 req-c5849cee-e3cc-44ce-8507-cd7832513602 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] No waiting events found dispatching network-vif-unplugged-c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG nova.compute.manager [req-213cf456-b10a-4237-8acd-981e946ecdd7 req-c5849cee-e3cc-44ce-8507-cd7832513602 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Received event network-vif-unplugged-c0b475f1-01a2-4492-ac88-67f44080f771 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:51:25 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Instance destroyed successfully.
Apr 13 21:51:25 user nova-compute[71325]: DEBUG nova.objects.instance [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lazy-loading 'resources' on Instance uuid be81f393-654b-4b50-856e-00818f3ae59e {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-452847607',display_name='tempest-VolumesAdminNegativeTest-server-452847607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-452847607',id=9,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOVPDIms8lGQmxW0b6d+PIMb94QdlHp7hlh+Q/5jFinTckEYdyLh00UbgoM7ROLffK93N7l3ulRDVVB1s0zuiy0lE4iXR7lWtCVRO2tXqkvRZAl7MFNGrmKz7BzYb2Gyw==',key_name='tempest-keypair-1995468323',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03a67a9a0d514f19b6cc0b39477a1b42',ramdisk_id='',reservation_id='r-ydrglqo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1461294072',owner_user_name='tempest-VolumesAdminNegativeTest-1461294072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:45:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e87956414a49c4b3c34e51fe6ed2ec',uuid=be81f393-654b-4b50-856e-00818f3ae59e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0b475f1-01a2-4492-ac88-67f44080f771", "address": "fa:16:3e:02:59:10", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0b475f1-01", "ovs_interfaceid": "c0b475f1-01a2-4492-ac88-67f44080f771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Converting VIF {"id": "c0b475f1-01a2-4492-ac88-67f44080f771", "address": "fa:16:3e:02:59:10", "network": {"id": "25a51e04-88d5-45b8-865b-f2c7da7460b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1084566761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03a67a9a0d514f19b6cc0b39477a1b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0b475f1-01", "ovs_interfaceid": "c0b475f1-01a2-4492-ac88-67f44080f771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:59:10,bridge_name='br-int',has_traffic_filtering=True,id=c0b475f1-01a2-4492-ac88-67f44080f771,network=Network(25a51e04-88d5-45b8-865b-f2c7da7460b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0b475f1-01') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:25 user nova-compute[71325]: DEBUG os_vif [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:59:10,bridge_name='br-int',has_traffic_filtering=True,id=c0b475f1-01a2-4492-ac88-67f44080f771,network=Network(25a51e04-88d5-45b8-865b-f2c7da7460b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0b475f1-01') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:51:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0b475f1-01, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:51:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:26 user nova-compute[71325]: INFO os_vif [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:59:10,bridge_name='br-int',has_traffic_filtering=True,id=c0b475f1-01a2-4492-ac88-67f44080f771,network=Network(25a51e04-88d5-45b8-865b-f2c7da7460b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0b475f1-01')
Apr 13 21:51:26 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Deleting instance files /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e_del
Apr 13 21:51:26 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Deletion of /opt/stack/data/nova/instances/be81f393-654b-4b50-856e-00818f3ae59e_del complete
Apr 13 21:51:26 user nova-compute[71325]: INFO nova.compute.manager [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 13 21:51:26 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:51:26 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:51:26 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: be81f393-654b-4b50-856e-00818f3ae59e] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:51:27 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:51:27 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Took 1.08 seconds to deallocate network for instance.
Apr 13 21:51:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-cad3f7f3-7529-433b-983c-f43b2b2e4860 req-ea6bb183-97ea-4843-aacf-f938d9f5cff5 service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Received event network-vif-deleted-c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:27 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:51:27 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:51:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-e5f0f0ba-4cdb-4af0-9b06-ed03fa9d80c3 req-e5951bb8-a562-4bab-8a18-8a8e750c0b0a service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Received event network-vif-plugged-c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e5f0f0ba-4cdb-4af0-9b06-ed03fa9d80c3 req-e5951bb8-a562-4bab-8a18-8a8e750c0b0a service nova] Acquiring lock "be81f393-654b-4b50-856e-00818f3ae59e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e5f0f0ba-4cdb-4af0-9b06-ed03fa9d80c3 req-e5951bb8-a562-4bab-8a18-8a8e750c0b0a service nova] Lock "be81f393-654b-4b50-856e-00818f3ae59e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e5f0f0ba-4cdb-4af0-9b06-ed03fa9d80c3 req-e5951bb8-a562-4bab-8a18-8a8e750c0b0a service nova] Lock "be81f393-654b-4b50-856e-00818f3ae59e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-e5f0f0ba-4cdb-4af0-9b06-ed03fa9d80c3 req-e5951bb8-a562-4bab-8a18-8a8e750c0b0a service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] No waiting events found dispatching network-vif-plugged-c0b475f1-01a2-4492-ac88-67f44080f771 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:27 user nova-compute[71325]: WARNING nova.compute.manager [req-e5f0f0ba-4cdb-4af0-9b06-ed03fa9d80c3 req-e5951bb8-a562-4bab-8a18-8a8e750c0b0a service nova] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Received unexpected event network-vif-plugged-c0b475f1-01a2-4492-ac88-67f44080f771 for instance with vm_state deleted and task_state None.
Apr 13 21:51:27 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Deleted allocations for instance be81f393-654b-4b50-856e-00818f3ae59e
Apr 13 21:51:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "be81f393-654b-4b50-856e-00818f3ae59e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.565s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "fe05a421-ee64-492b-a338-0e864458908c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:36 user nova-compute[71325]: INFO nova.compute.manager [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Terminating instance
Apr 13 21:51:36 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-dcf91d0d-f106-406d-ab39-7fc31ada5a36 req-dd0cfbb8-2da5-44fa-9965-7c4481df232b service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-vif-unplugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dcf91d0d-f106-406d-ab39-7fc31ada5a36 req-dd0cfbb8-2da5-44fa-9965-7c4481df232b service nova] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dcf91d0d-f106-406d-ab39-7fc31ada5a36 req-dd0cfbb8-2da5-44fa-9965-7c4481df232b service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dcf91d0d-f106-406d-ab39-7fc31ada5a36 req-dd0cfbb8-2da5-44fa-9965-7c4481df232b service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-dcf91d0d-f106-406d-ab39-7fc31ada5a36 req-dd0cfbb8-2da5-44fa-9965-7c4481df232b service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] No waiting events found dispatching network-vif-unplugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-dcf91d0d-f106-406d-ab39-7fc31ada5a36 req-dd0cfbb8-2da5-44fa-9965-7c4481df232b service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-vif-unplugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:51:37 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: fe05a421-ee64-492b-a338-0e864458908c] Instance destroyed successfully.
Apr 13 21:51:37 user nova-compute[71325]: DEBUG nova.objects.instance [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'resources' on Instance uuid fe05a421-ee64-492b-a338-0e864458908c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1041715874',display_name='tempest-TestMinimumBasicScenario-server-1041715874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1041715874',id=12,image_ref='151f8298-2e7c-4c5b-b82a-496f9533b342',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrF4HyOOJH3pMivnghQrjFo+W8h3ND4pdRgXep1SFS8/WTYjcNCQm2ws2bOjH7uTrYfCv8CUrUqbd3voRDTocx9SqboUPZF+TWklO/M1CRGmsArlRpxU4SyKxVWG+qBZw==',key_name='tempest-TestMinimumBasicScenario-1695743106',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:46:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d4e8c27ff7d4fa9a61e000c9d02c5f4',ramdisk_id='',reservation_id='r-vzgmgg3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='151f8298-2e7c-4c5b-b82a-496f9533b342',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1800545339',owner_user_name='tempest-TestMinimumBasicScenario-1800545339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:48:57Z,user_data=None,user_id='710e0446cf794e94b3ab29bb0d7e10d8',uuid=fe05a421-ee64-492b-a338-0e864458908c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converting VIF {"id": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "address": "fa:16:3e:cf:dc:b4", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc784b-1f", "ovs_interfaceid": "a6dc784b-1fab-4f4b-8e84-8df1f191b373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:dc:b4,bridge_name='br-int',has_traffic_filtering=True,id=a6dc784b-1fab-4f4b-8e84-8df1f191b373,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc784b-1f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG os_vif [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:dc:b4,bridge_name='br-int',has_traffic_filtering=True,id=a6dc784b-1fab-4f4b-8e84-8df1f191b373,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc784b-1f') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6dc784b-1f, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:37 user nova-compute[71325]: INFO os_vif [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:dc:b4,bridge_name='br-int',has_traffic_filtering=True,id=a6dc784b-1fab-4f4b-8e84-8df1f191b373,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc784b-1f')
Apr 13 21:51:37 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Deleting instance files /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c_del
Apr 13 21:51:37 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Deletion of /opt/stack/data/nova/instances/fe05a421-ee64-492b-a338-0e864458908c_del complete
Apr 13 21:51:37 user nova-compute[71325]: INFO nova.compute.manager [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 13 21:51:37 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: fe05a421-ee64-492b-a338-0e864458908c] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: fe05a421-ee64-492b-a338-0e864458908c] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:37 user nova-compute[71325]: INFO nova.compute.manager [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Detaching volume 5b928772-e4f8-489b-93b3-282f3c7c184b
Apr 13 21:51:37 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:51:37 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: fe05a421-ee64-492b-a338-0e864458908c] Took 0.49 seconds to deallocate network for instance.
Apr 13 21:51:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-8c755e67-cc88-420f-8405-ad4566948678 req-2076a062-7fe5-420b-9a8e-292505494bd8 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-vif-deleted-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:37 user nova-compute[71325]: INFO nova.compute.manager [req-8c755e67-cc88-420f-8405-ad4566948678 req-2076a062-7fe5-420b-9a8e-292505494bd8 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Neutron deleted interface a6dc784b-1fab-4f4b-8e84-8df1f191b373; detaching it from the instance and deleting it from the info cache
Apr 13 21:51:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-8c755e67-cc88-420f-8405-ad4566948678 req-2076a062-7fe5-420b-9a8e-292505494bd8 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:51:37 user nova-compute[71325]: INFO nova.virt.block_device [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Attempting to driver detach volume 5b928772-e4f8-489b-93b3-282f3c7c184b from mountpoint /dev/vdb
Apr 13 21:51:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-8c755e67-cc88-420f-8405-ad4566948678 req-2076a062-7fe5-420b-9a8e-292505494bd8 service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Detach interface failed, port_id=a6dc784b-1fab-4f4b-8e84-8df1f191b373, reason: Instance fe05a421-ee64-492b-a338-0e864458908c could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Attempting to detach device vdb from instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:51:37 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:51:37 user nova-compute[71325]:   <source dev="/dev/sdd"/>
Apr 13 21:51:37 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:51:37 user nova-compute[71325]:   <serial>5b928772-e4f8-489b-93b3-282f3c7c184b</serial>
Apr 13 21:51:37 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:51:37 user nova-compute[71325]: </disk>
Apr 13 21:51:37 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:51:37 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Successfully detached device vdb from instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 from the persistent domain config.
Apr 13 21:51:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:51:37 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:51:37 user nova-compute[71325]:   <source dev="/dev/sdd"/>
Apr 13 21:51:37 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:51:37 user nova-compute[71325]:   <serial>5b928772-e4f8-489b-93b3-282f3c7c184b</serial>
Apr 13 21:51:37 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:51:37 user nova-compute[71325]: </disk>
Apr 13 21:51:37 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681422698.1565576, af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:51:38 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Successfully detached device vdb from instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 from the live domain config.
Apr 13 21:51:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YofKpNRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:51:38 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3558c51f-e7ed-46dc-9c2e-8f54448bb429]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:51:38 user nova-compute[71325]: No targets found.
Apr 13 21:51:38 user nova-compute[71325]: iSNS:
Apr 13 21:51:38 user nova-compute[71325]: No targets found.
Apr 13 21:51:38 user nova-compute[71325]: STATIC:
Apr 13 21:51:38 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d
Apr 13 21:51:38 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:51:38 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:51:38 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6
Apr 13 21:51:38 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:51:38 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:51:38 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763
Apr 13 21:51:38 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:51:38 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:51:38 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227
Apr 13 21:51:38 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:51:38 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:51:38 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12
Apr 13 21:51:38 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:51:38 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:51:38 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b
Apr 13 21:51:38 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:51:38 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:51:38 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3
Apr 13 21:51:38 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:51:38 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:51:38 user nova-compute[71325]: FIRMWARE:
Apr 13 21:51:38 user nova-compute[71325]: No targets found.
Apr 13 21:51:38 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:51:38 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:51:38 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c238fb80-214e-4267-96a0-8986271d26fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:38 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Deleted allocations for instance fe05a421-ee64-492b-a338-0e864458908c
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[52de263c-fdcf-4e2a-a5d5-5369460ffea5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:51:38 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:51:38 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:51:38 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:51:38 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:51:38 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:51:38 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:51:38 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b (non-flash)
Apr 13 21:51:38 user nova-compute[71325]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:51:38 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:51:38 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:51:38 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:51:38 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:51:38 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:51:38 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7e1dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b'): ({'sdd'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Removing single pathed devices sdd {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[addd0324-436f-4fd9-8acf-6e3e0c0acf1a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bbdc8c-4a9c-468e-a712-c64b80025784]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Flushing IO for device /dev/sdd {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "fe05a421-ee64-492b-a338-0e864458908c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.975s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6058ea-7f77-4e88-b8f9-8d8be12f4afb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[365f1295-dfcb-4fe1-8dc1-c469611deb2c]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] SCSI volumes sdd have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3014271b-9e1c-4b23-85fa-601ee288686a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[51703e0c-2d25-4925-8460-3b617ead895e]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b, portal: 172.16.0.220,3260]
Apr 13 21:51:38 user nova-compute[71325]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b, portal: 172.16.0.220,3260] successful.
Apr 13 21:51:38 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b928772-e4f8-489b-93b3-282f3c7c184b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d19a3a3-92e7-466f-8093-d21cc5c94066]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] <== disconnect_volume: return (338ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-af22d0b2-7972-4e7e-8ca3-58a4c3374a74 req-15d941e1-de72-4459-aab7-e0b09dc56b5f service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received event network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-af22d0b2-7972-4e7e-8ca3-58a4c3374a74 req-15d941e1-de72-4459-aab7-e0b09dc56b5f service nova] Acquiring lock "fe05a421-ee64-492b-a338-0e864458908c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-af22d0b2-7972-4e7e-8ca3-58a4c3374a74 req-15d941e1-de72-4459-aab7-e0b09dc56b5f service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-af22d0b2-7972-4e7e-8ca3-58a4c3374a74 req-15d941e1-de72-4459-aab7-e0b09dc56b5f service nova] Lock "fe05a421-ee64-492b-a338-0e864458908c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-af22d0b2-7972-4e7e-8ca3-58a4c3374a74 req-15d941e1-de72-4459-aab7-e0b09dc56b5f service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] No waiting events found dispatching network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:38 user nova-compute[71325]: WARNING nova.compute.manager [req-af22d0b2-7972-4e7e-8ca3-58a4c3374a74 req-15d941e1-de72-4459-aab7-e0b09dc56b5f service nova] [instance: fe05a421-ee64-492b-a338-0e864458908c] Received unexpected event network-vif-plugged-a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance with vm_state deleted and task_state None.
Apr 13 21:51:39 user nova-compute[71325]: DEBUG nova.objects.instance [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'flavor' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:51:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.693s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:40 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422685.957814, be81f393-654b-4b50-856e-00818f3ae59e => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:51:40 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: be81f393-654b-4b50-856e-00818f3ae59e] VM Stopped (Lifecycle Event)
Apr 13 21:51:40 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0749a840-0f11-4f6b-b138-10fae46a1a86 None None] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:51:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:45 user nova-compute[71325]: INFO nova.compute.manager [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Unrescuing
Apr 13 21:51:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:51:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquired lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:51:45 user nova-compute[71325]: DEBUG nova.network.neutron [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:51:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:45 user nova-compute[71325]: INFO nova.compute.manager [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Terminating instance
Apr 13 21:51:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:51:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG nova.network.neutron [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Updating instance_info_cache with network_info: [{"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Releasing lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG nova.objects.instance [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'flavor' on Instance uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-7fc81fb6-edf3-4c1f-9ca9-876f8d91729a req-b11eba14-dde2-40a5-9fce-390985d30c8c service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-vif-unplugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7fc81fb6-edf3-4c1f-9ca9-876f8d91729a req-b11eba14-dde2-40a5-9fce-390985d30c8c service nova] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7fc81fb6-edf3-4c1f-9ca9-876f8d91729a req-b11eba14-dde2-40a5-9fce-390985d30c8c service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7fc81fb6-edf3-4c1f-9ca9-876f8d91729a req-b11eba14-dde2-40a5-9fce-390985d30c8c service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-7fc81fb6-edf3-4c1f-9ca9-876f8d91729a req-b11eba14-dde2-40a5-9fce-390985d30c8c service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] No waiting events found dispatching network-vif-unplugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-7fc81fb6-edf3-4c1f-9ca9-876f8d91729a req-b11eba14-dde2-40a5-9fce-390985d30c8c service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-vif-unplugged-e918ab8f-9fcd-47df-974d-eb6568414011 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-7d4d822e-d9f3-4c34-8e30-364ebaf29655 req-01ed8d15-651a-4ae0-89f7-c4c9c946f4a9 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-vif-unplugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7d4d822e-d9f3-4c34-8e30-364ebaf29655 req-01ed8d15-651a-4ae0-89f7-c4c9c946f4a9 service nova] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7d4d822e-d9f3-4c34-8e30-364ebaf29655 req-01ed8d15-651a-4ae0-89f7-c4c9c946f4a9 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7d4d822e-d9f3-4c34-8e30-364ebaf29655 req-01ed8d15-651a-4ae0-89f7-c4c9c946f4a9 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-7d4d822e-d9f3-4c34-8e30-364ebaf29655 req-01ed8d15-651a-4ae0-89f7-c4c9c946f4a9 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] No waiting events found dispatching network-vif-unplugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:46 user nova-compute[71325]: WARNING nova.compute.manager [req-7d4d822e-d9f3-4c34-8e30-364ebaf29655 req-01ed8d15-651a-4ae0-89f7-c4c9c946f4a9 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received unexpected event network-vif-unplugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:51:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:46 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Instance destroyed successfully.
Apr 13 21:51:46 user nova-compute[71325]: DEBUG nova.objects.instance [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'resources' on Instance uuid eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1025681919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1025681919',id=6,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7Ml5lpGb1VqwPVwkwwsf5pboDo62epDSWqFRNEqAUVYF/2w516xO62Qmmp9j0l22MQEwYg4/k1ON4am0hAmYwpEbqC0e1pEBIaEp/IKSH66LA6p3lpAdZWEotG6J5hwQ==',key_name='tempest-keypair-1819128718',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:49:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73c23bc3e8b14441b4622095502b5dae',ramdisk_id='',reservation_id='r-m0kiebsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-710815470',owner_user_name='tempest-AttachVolumeShelveTestJSON-710815470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:49:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f151b673e3d47acb9c3ed9b9ecaf687',uuid=eaff33f4-c1f5-45c5-b54f-555d1c66e8c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converting VIF {"id": "e918ab8f-9fcd-47df-974d-eb6568414011", "address": "fa:16:3e:7c:19:65", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape918ab8f-9f", "ovs_interfaceid": "e918ab8f-9fcd-47df-974d-eb6568414011", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:19:65,bridge_name='br-int',has_traffic_filtering=True,id=e918ab8f-9fcd-47df-974d-eb6568414011,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape918ab8f-9f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG os_vif [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:19:65,bridge_name='br-int',has_traffic_filtering=True,id=e918ab8f-9fcd-47df-974d-eb6568414011,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape918ab8f-9f') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape918ab8f-9f, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:51:46 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Instance destroyed successfully.
Apr 13 21:51:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:46 user nova-compute[71325]: INFO os_vif [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:19:65,bridge_name='br-int',has_traffic_filtering=True,id=e918ab8f-9fcd-47df-974d-eb6568414011,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape918ab8f-9f')
Apr 13 21:51:46 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Deleting instance files /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7_del
Apr 13 21:51:46 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Deletion of /opt/stack/data/nova/instances/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7_del complete
Apr 13 21:51:46 user nova-compute[71325]: INFO nova.compute.manager [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Took 1.26 seconds to destroy the instance on the hypervisor.
Apr 13 21:51:46 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:51:46 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:51:47 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:51:47 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Took 0.72 seconds to deallocate network for instance.
Apr 13 21:51:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:47 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Refreshing inventories for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 21:51:47 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Updating ProviderTree inventory for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 21:51:47 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Updating inventory in ProviderTree for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 21:51:47 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Refreshing aggregate associations for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55, aggregates: None {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 21:51:47 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Refreshing trait associations for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-bbd25ce1-f489-43f3-852a-47194469347f req-886c1aeb-d612-4df8-9c2b-2e139fc69acc service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bbd25ce1-f489-43f3-852a-47194469347f req-886c1aeb-d612-4df8-9c2b-2e139fc69acc service nova] Acquiring lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bbd25ce1-f489-43f3-852a-47194469347f req-886c1aeb-d612-4df8-9c2b-2e139fc69acc service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bbd25ce1-f489-43f3-852a-47194469347f req-886c1aeb-d612-4df8-9c2b-2e139fc69acc service nova] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-bbd25ce1-f489-43f3-852a-47194469347f req-886c1aeb-d612-4df8-9c2b-2e139fc69acc service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] No waiting events found dispatching network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:48 user nova-compute[71325]: WARNING nova.compute.manager [req-bbd25ce1-f489-43f3-852a-47194469347f req-886c1aeb-d612-4df8-9c2b-2e139fc69acc service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received unexpected event network-vif-plugged-e918ab8f-9fcd-47df-974d-eb6568414011 for instance with vm_state deleted and task_state None.
Apr 13 21:51:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-bbd25ce1-f489-43f3-852a-47194469347f req-886c1aeb-d612-4df8-9c2b-2e139fc69acc service nova] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Received event network-vif-deleted-e918ab8f-9fcd-47df-974d-eb6568414011 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:48 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Deleted allocations for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7
Apr 13 21:51:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.730s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-7fd4f22f-9e83-47f6-b85b-06040931d78c req-ee1d3d2f-0c5c-4e9d-86ab-69141dde889b service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7fd4f22f-9e83-47f6-b85b-06040931d78c req-ee1d3d2f-0c5c-4e9d-86ab-69141dde889b service nova] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7fd4f22f-9e83-47f6-b85b-06040931d78c req-ee1d3d2f-0c5c-4e9d-86ab-69141dde889b service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7fd4f22f-9e83-47f6-b85b-06040931d78c req-ee1d3d2f-0c5c-4e9d-86ab-69141dde889b service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-7fd4f22f-9e83-47f6-b85b-06040931d78c req-ee1d3d2f-0c5c-4e9d-86ab-69141dde889b service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] No waiting events found dispatching network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:48 user nova-compute[71325]: WARNING nova.compute.manager [req-7fd4f22f-9e83-47f6-b85b-06040931d78c req-ee1d3d2f-0c5c-4e9d-86ab-69141dde889b service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received unexpected event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:51:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:51:50 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422710.2627664, f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:51:50 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] VM Resumed (Lifecycle Event)
Apr 13 21:51:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:51:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:51:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:51:50 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 21:51:50 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422710.26486, f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:51:50 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] VM Started (Lifecycle Event)
Apr 13 21:51:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:51:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:51:50 user nova-compute[71325]: DEBUG nova.compute.manager [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:50 user nova-compute[71325]: DEBUG nova.compute.manager [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] No waiting events found dispatching network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:50 user nova-compute[71325]: WARNING nova.compute.manager [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received unexpected event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance with vm_state active and task_state None.
Apr 13 21:51:50 user nova-compute[71325]: DEBUG nova.compute.manager [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:51:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:50 user nova-compute[71325]: DEBUG nova.compute.manager [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] No waiting events found dispatching network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:51:50 user nova-compute[71325]: WARNING nova.compute.manager [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received unexpected event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance with vm_state active and task_state None.
Apr 13 21:51:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:52 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422697.105904, fe05a421-ee64-492b-a338-0e864458908c => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:51:52 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: fe05a421-ee64-492b-a338-0e864458908c] VM Stopped (Lifecycle Event)
Apr 13 21:51:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-437e4e71-0342-4de8-96c8-47ef182e8500 None None] [instance: fe05a421-ee64-492b-a338-0e864458908c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:51:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid 8645ede7-1e10-4520-8092-6cc6dfc3d82a {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid 68cb788e-be1f-44fc-b65e-b908a5831ae2 {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid b5ce77dc-eda4-4b96-8d61-2297d986f3ee {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid f16c661a-6f38-43fe-a801-a69de6e687ea {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "68cb788e-be1f-44fc-b65e-b908a5831ae2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:51:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:51:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:01 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422706.7318845, eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:52:01 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] VM Stopped (Lifecycle Event)
Apr 13 21:52:01 user nova-compute[71325]: DEBUG nova.compute.manager [None req-08a4eaca-86e6-4f3b-b71a-80c8bdbe4897 None None] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "6fbf2022-b069-440f-8513-6d107f0a7180" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:03 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:52:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:03 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:52:03 user nova-compute[71325]: INFO nova.compute.claims [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Claim successful on node user
Apr 13 21:52:03 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:52:03 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:52:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:03 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:52:03 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:52:03 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:52:03 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:52:03 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:52:03 user nova-compute[71325]: INFO nova.virt.block_device [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Booting with blank volume at /dev/vda
Apr 13 21:52:03 user nova-compute[71325]: DEBUG nova.policy [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:52:03 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Successfully created port: fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:04 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Successfully updated port: fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquired lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-7f783312-5ad6-4c01-8a01-fb6ca9253639 req-684199b6-d4da-4e01-a872-a1463f5c05b6 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-changed-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-7f783312-5ad6-4c01-8a01-fb6ca9253639 req-684199b6-d4da-4e01-a872-a1463f5c05b6 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Refreshing instance network info cache due to event network-changed-fee95846-6886-4a1a-b7cb-53bd1c1977d8. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7f783312-5ad6-4c01-8a01-fb6ca9253639 req-684199b6-d4da-4e01-a872-a1463f5c05b6 service nova] Acquiring lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Updating instance_info_cache with network_info: [{"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Releasing lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Instance network_info: |[{"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7f783312-5ad6-4c01-8a01-fb6ca9253639 req-684199b6-d4da-4e01-a872-a1463f5c05b6 service nova] Acquired lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG nova.network.neutron [req-7f783312-5ad6-4c01-8a01-fb6ca9253639 req-684199b6-d4da-4e01-a872-a1463f5c05b6 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Refreshing network info cache for port fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG nova.network.neutron [req-7f783312-5ad6-4c01-8a01-fb6ca9253639 req-684199b6-d4da-4e01-a872-a1463f5c05b6 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Updated VIF entry in instance network info cache for port fee95846-6886-4a1a-b7cb-53bd1c1977d8. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG nova.network.neutron [req-7f783312-5ad6-4c01-8a01-fb6ca9253639 req-684199b6-d4da-4e01-a872-a1463f5c05b6 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Updating instance_info_cache with network_info: [{"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7f783312-5ad6-4c01-8a01-fb6ca9253639 req-684199b6-d4da-4e01-a872-a1463f5c05b6 service nova] Releasing lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:07 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:52:07 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:52:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7659MB free_disk=26.282974243164062GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f16c661a-6f38-43fe-a801-a69de6e687ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:52:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:52:08 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:52:08 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:52:08 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:52:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG os_brick.utils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a96ad23-485b-4e4a-a67a-5adb8f9e6864]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[99acdc1f-aa82-403e-97e9-ce94055b7756]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4379cf4-532d-4041-a084-fe3c5d67411a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c544a24-90e7-46e7-a128-8d14d9440651]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:52:09 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2853a690-e0da-4577-a89a-93f506438b55]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG os_brick.utils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Updating existing volume attachment record: 64c44592-ffba-456d-8ee8-bb583b9c6fbc {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Didn't find any instances for network info cache update. {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:52:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG nova.objects.instance [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'flavor' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:10 user nova-compute[71325]: INFO nova.compute.manager [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Attaching volume 6c038cb0-7b1c-4305-97d8-318974560720 to /dev/vdb
Apr 13 21:52:10 user nova-compute[71325]: DEBUG os_brick.utils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e5a05a-ed09-4d2e-810d-a5dc01617ab8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[34677272-f823-4df0-8f59-f913dc0d8e00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f195f7-4870-41b8-a2ec-060f9defba36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7528ec7-d344-4a35-90a6-a249489d0b5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:52:10 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:52:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a23dda-7fa4-435a-a34a-4594d9908de2]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG os_brick.utils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:52:10 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating existing volume attachment record: 8866a315-44b4-45c5-991e-c324300362d2 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:52:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:52:13 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Creating image(s)
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Ensure instance console log exists: /opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Start _get_guest_xml network_info=[{"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVSNAbZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6fbf2022-b069-440f-8513-6d107f0a7180', 'attached_at': '', 'detached_at': '', 'volume_id': '2e3f9d31-e4a2-4e3d-9823-819f1c1244ce', 'serial': '2e3f9d31-e4a2-4e3d-9823-819f1c1244ce'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '64c44592-ffba-456d-8ee8-bb583b9c6fbc', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:52:13 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:52:13 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVSNAbZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:52:13 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:52:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:52:13 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:52:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:52:13 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f1c418-c889-4b75-8773-f2846224431e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:52:13 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[316f29e9-31fd-4bca-b3c7-d7dd5dd8acdb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce] added
Apr 13 21:52:13 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce71b767-77be-4060-a36e-06196424c735]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2412b982-ae72-4a0e-a8b1-3d3d34380fac]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gVSNAbZE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gVSNAbZE" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c125599-3729-45e5-9081-b615aa26824e]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gVSNAbZE'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5511af7-d1e6-4c21-97e3-dafddd16f36a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6449fb6c-04e8-428f-afe1-fc0e3fd24d5b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5493cf-2ded-43a6-97ba-015231eea1ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce, portal: 172.16.0.220,3260]
Apr 13 21:52:14 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce, portal: 172.16.0.220,3260] successful.
Apr 13 21:52:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de4b08a-aef2-42c8-82fb-aafe8774130f]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[180d6a20-f918-423d-ac89-016aa7ef6e85]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:14 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cb2fb9-c1d4-453a-af25-e31895544881]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVSNAbZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:52:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFsfLcoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:52:15 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26634393766356666', 'path': '/dev/sdd'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634393766356666', 'path': '/dev/sdd'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.020s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:52:15 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:52:15 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3b54b8-034e-44aa-9daa-1d4972e70781]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:52:15 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1476604230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1476604230',id=19,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11a30fba887e4114be856d26b47a8e55',ramdisk_id='',reservation_id='r-t2ph803w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-33854562',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:52:04Z,user_data=None,user_id='0ab740920cac4befac62a72f7ce5a817',uuid=6fbf2022-b069-440f-8513-6d107f0a7180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converting VIF {"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=fee95846-6886-4a1a-b7cb-53bd1c1977d8,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95846-68') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG nova.objects.instance [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fbf2022-b069-440f-8513-6d107f0a7180 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[51586e31-78a8-4a49-acd0-b4e93b2c9e0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720] added
Apr 13 21:52:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:52:15 user nova-compute[71325]:   <uuid>6fbf2022-b069-440f-8513-6d107f0a7180</uuid>
Apr 13 21:52:15 user nova-compute[71325]:   <name>instance-00000013</name>
Apr 13 21:52:15 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:52:15 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:52:15 user nova-compute[71325]:   <metadata>
Apr 13 21:52:15 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:52:15 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:52:15 user nova-compute[71325]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1476604230</nova:name>
Apr 13 21:52:15 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:52:13</nova:creationTime>
Apr 13 21:52:15 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:52:15 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:52:15 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:52:15 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:52:15 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:52:15 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:52:15 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:52:15 user nova-compute[71325]:       <nova:owner>
Apr 13 21:52:15 user nova-compute[71325]:         <nova:user uuid="0ab740920cac4befac62a72f7ce5a817">tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member</nova:user>
Apr 13 21:52:15 user nova-compute[71325]:         <nova:project uuid="11a30fba887e4114be856d26b47a8e55">tempest-ServerBootFromVolumeStableRescueTest-33854562</nova:project>
Apr 13 21:52:15 user nova-compute[71325]:       </nova:owner>
Apr 13 21:52:15 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:52:15 user nova-compute[71325]:       <nova:ports>
Apr 13 21:52:15 user nova-compute[71325]:         <nova:port uuid="fee95846-6886-4a1a-b7cb-53bd1c1977d8">
Apr 13 21:52:15 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 21:52:15 user nova-compute[71325]:         </nova:port>
Apr 13 21:52:15 user nova-compute[71325]:       </nova:ports>
Apr 13 21:52:15 user nova-compute[71325]:     </nova:instance>
Apr 13 21:52:15 user nova-compute[71325]:   </metadata>
Apr 13 21:52:15 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:52:15 user nova-compute[71325]:     <system>
Apr 13 21:52:15 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:52:15 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:52:15 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:52:15 user nova-compute[71325]:       <entry name="serial">6fbf2022-b069-440f-8513-6d107f0a7180</entry>
Apr 13 21:52:15 user nova-compute[71325]:       <entry name="uuid">6fbf2022-b069-440f-8513-6d107f0a7180</entry>
Apr 13 21:52:15 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:52:15 user nova-compute[71325]:     </system>
Apr 13 21:52:15 user nova-compute[71325]:   </sysinfo>
Apr 13 21:52:15 user nova-compute[71325]:   <os>
Apr 13 21:52:15 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:52:15 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:52:15 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:52:15 user nova-compute[71325]:   </os>
Apr 13 21:52:15 user nova-compute[71325]:   <features>
Apr 13 21:52:15 user nova-compute[71325]:     <acpi/>
Apr 13 21:52:15 user nova-compute[71325]:     <apic/>
Apr 13 21:52:15 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:52:15 user nova-compute[71325]:   </features>
Apr 13 21:52:15 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:52:15 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:52:15 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:52:15 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:52:15 user nova-compute[71325]:   </clock>
Apr 13 21:52:15 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:52:15 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:52:15 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:52:15 user nova-compute[71325]:   </cpu>
Apr 13 21:52:15 user nova-compute[71325]:   <devices>
Apr 13 21:52:15 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:52:15 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:52:15 user nova-compute[71325]:       <source dev="/dev/sdd"/>
Apr 13 21:52:15 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:52:15 user nova-compute[71325]:       <serial>2e3f9d31-e4a2-4e3d-9823-819f1c1244ce</serial>
Apr 13 21:52:15 user nova-compute[71325]:     </disk>
Apr 13 21:52:15 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:52:15 user nova-compute[71325]:       <mac address="fa:16:3e:2f:96:1e"/>
Apr 13 21:52:15 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:52:15 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:52:15 user nova-compute[71325]:       <target dev="tapfee95846-68"/>
Apr 13 21:52:15 user nova-compute[71325]:     </interface>
Apr 13 21:52:15 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:52:15 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/console.log" append="off"/>
Apr 13 21:52:15 user nova-compute[71325]:     </serial>
Apr 13 21:52:15 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:52:15 user nova-compute[71325]:     <video>
Apr 13 21:52:15 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:52:15 user nova-compute[71325]:     </video>
Apr 13 21:52:15 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:52:15 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:52:15 user nova-compute[71325]:     </rng>
Apr 13 21:52:15 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:52:15 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:52:15 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:52:15 user nova-compute[71325]:     </memballoon>
Apr 13 21:52:15 user nova-compute[71325]:   </devices>
Apr 13 21:52:15 user nova-compute[71325]: </domain>
Apr 13 21:52:15 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1476604230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1476604230',id=19,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11a30fba887e4114be856d26b47a8e55',ramdisk_id='',reservation_id='r-t2ph803w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-33854562',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:52:04Z,user_data=None,user_id='0ab740920cac4befac62a72f7ce5a817',uuid=6fbf2022-b069-440f-8513-6d107f0a7180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converting VIF {"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=fee95846-6886-4a1a-b7cb-53bd1c1977d8,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95846-68') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_vif [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=fee95846-6886-4a1a-b7cb-53bd1c1977d8,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95846-68') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d058556c-4433-4866-9132-d3627d5e5991]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfee95846-68, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfee95846-68, col_values=(('external_ids', {'iface-id': 'fee95846-6886-4a1a-b7cb-53bd1c1977d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:96:1e', 'vm-uuid': '6fbf2022-b069-440f-8513-6d107f0a7180'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a649e051-f9dc-41e1-81d4-0948f1cd4f8b]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:15 user nova-compute[71325]: INFO os_vif [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=fee95846-6886-4a1a-b7cb-53bd1c1977d8,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95846-68')
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFsfLcoj {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFsfLcoj" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97385a4-27de-4c87-9cd5-9a63f54c6b9c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eFsfLcoj'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[264a2bfd-30b2-44fe-9331-c605d28f49c9]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] No VIF found with MAC fa:16:3e:2f:96:1e, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d55931-6160-42c1-96dc-daf3b1883483]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6a7d3c-bc30-4f17-8d45-9588ee571321]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260]
Apr 13 21:52:15 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260] successful.
Apr 13 21:52:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fc78c6-c386-4a25-9efa-0be895f435c1]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c01900-45ec-4c95-894f-6a0d7dbb89dc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:15 user nova-compute[71325]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:52:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HCTL ('40', '-', '-', 0) found on session 22 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b88b773-cec2-4114-82f5-d57088ce4b81]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Searching for a device in session 22 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:52:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFsfLcoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:52:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:52:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26463363934663764', 'path': '/dev/sdi'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:52:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463363934663764', 'path': '/dev/sdi'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:52:16 user nova-compute[71325]: DEBUG nova.objects.instance [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'flavor' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:52:16 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:52:16 user nova-compute[71325]:   <source dev="/dev/sdi"/>
Apr 13 21:52:16 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:52:16 user nova-compute[71325]:   <serial>6c038cb0-7b1c-4305-97d8-318974560720</serial>
Apr 13 21:52:16 user nova-compute[71325]: </disk>
Apr 13 21:52:16 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:52:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-69acd10e-152d-4085-8d13-777046021769 req-54c8410b-cc5e-4713-9814-97b702e7c5f8 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-69acd10e-152d-4085-8d13-777046021769 req-54c8410b-cc5e-4713-9814-97b702e7c5f8 service nova] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-69acd10e-152d-4085-8d13-777046021769 req-54c8410b-cc5e-4713-9814-97b702e7c5f8 service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-69acd10e-152d-4085-8d13-777046021769 req-54c8410b-cc5e-4713-9814-97b702e7c5f8 service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-69acd10e-152d-4085-8d13-777046021769 req-54c8410b-cc5e-4713-9814-97b702e7c5f8 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] No waiting events found dispatching network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:17 user nova-compute[71325]: WARNING nova.compute.manager [req-69acd10e-152d-4085-8d13-777046021769 req-54c8410b-cc5e-4713-9814-97b702e7c5f8 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received unexpected event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance with vm_state building and task_state spawning.
Apr 13 21:52:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:52:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:52:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No VIF found with MAC fa:16:3e:ef:31:9d, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:52:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.899s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:18 user nova-compute[71325]: INFO nova.compute.manager [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Rebuilding instance
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'trusted_certs' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] No waiting events found dispatching network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:19 user nova-compute[71325]: WARNING nova.compute.manager [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received unexpected event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance with vm_state building and task_state spawning.
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-changed-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing instance network info cache due to event network-changed-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] Acquiring lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] Acquired lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.network.neutron [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Refreshing network info cache for port 24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'pci_requests' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'pci_devices' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'resources' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'migration_context' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71325) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422739.2033687, 6fbf2022-b069-440f-8513-6d107f0a7180 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:52:19 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] VM Resumed (Lifecycle Event)
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:52:19 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Instance spawned successfully.
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:19 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422739.2047913, 6fbf2022-b069-440f-8513-6d107f0a7180 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:52:19 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] VM Started (Lifecycle Event)
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:19 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:52:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:19 user nova-compute[71325]: INFO nova.compute.manager [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Took 5.58 seconds to spawn the instance on the hypervisor.
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:19 user nova-compute[71325]: INFO nova.compute.manager [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Took 16.31 seconds to build instance.
Apr 13 21:52:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "6fbf2022-b069-440f-8513-6d107f0a7180" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.397s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.network.neutron [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updated VIF entry in instance network info cache for port 24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.network.neutron [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [{"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "address": "fa:16:3e:b9:95:3c", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7587c8c4-a4", "ovs_interfaceid": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5be52063-b3a4-42e7-ba9c-7791634309ac", "address": "fa:16:3e:a0:f4:f4", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5be52063-b3", "ovs_interfaceid": "5be52063-b3a4-42e7-ba9c-7791634309ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f031ddd-e857-4075-9b14-e71dd6581d72", "address": "fa:16:3e:7f:c6:93", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f031ddd-e8", "ovs_interfaceid": "9f031ddd-e857-4075-9b14-e71dd6581d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "address": "fa:16:3e:e6:3d:82", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dfbfb87-41", "ovs_interfaceid": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] Releasing lock "refresh_cache-7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:52:19 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance destroyed successfully.
Apr 13 21:52:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:19 user nova-compute[71325]: INFO nova.compute.manager [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Terminating instance
Apr 13 21:52:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:52:20 user nova-compute[71325]: INFO nova.compute.manager [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Detaching volume 6c038cb0-7b1c-4305-97d8-318974560720
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: INFO nova.virt.block_device [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Attempting to driver detach volume 6c038cb0-7b1c-4305-97d8-318974560720 from mountpoint /dev/vdb
Apr 13 21:52:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Attempting to detach device vdb from instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:52:20 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:52:20 user nova-compute[71325]:   <source dev="/dev/sdi"/>
Apr 13 21:52:20 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:52:20 user nova-compute[71325]:   <serial>6c038cb0-7b1c-4305-97d8-318974560720</serial>
Apr 13 21:52:20 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:52:20 user nova-compute[71325]: </disk>
Apr 13 21:52:20 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:52:20 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully detached device vdb from instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 from the persistent domain config.
Apr 13 21:52:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFsfLcoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:52:20 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde0ee52-1972-491f-9753-37f55d56c7e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:52:20 user nova-compute[71325]: No targets found.
Apr 13 21:52:20 user nova-compute[71325]: iSNS:
Apr 13 21:52:20 user nova-compute[71325]: No targets found.
Apr 13 21:52:20 user nova-compute[71325]: STATIC:
Apr 13 21:52:20 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d
Apr 13 21:52:20 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:20 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:20 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720
Apr 13 21:52:20 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:20 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:20 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6
Apr 13 21:52:20 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:20 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:20 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763
Apr 13 21:52:20 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:20 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:20 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227
Apr 13 21:52:20 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:20 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:20 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:52:20 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:20 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:20 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12
Apr 13 21:52:20 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:20 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:20 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3
Apr 13 21:52:20 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:20 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:20 user nova-compute[71325]: FIRMWARE:
Apr 13 21:52:20 user nova-compute[71325]: No targets found.
Apr 13 21:52:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:52:20 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:52:20 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6170572-54ed-49c3-8d69-21382c21552d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1931105e-427b-4094-b3bf-ab549060376a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:52:20 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:20 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:20 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:20 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:20 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:20 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:20 user nova-compute[71325]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:52:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:52:20 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:20 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:20 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:20 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:20 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:20 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:20 user nova-compute[71325]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:52:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7e8de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720'): ({'sdi'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Removing single pathed devices sdi {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[324c44b2-a71d-432b-ac35-a74337768b44]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[476c2334-79ba-46f9-9861-daa56a921928]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flushing IO for device /dev/sdi {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf6c911-e2bb-4076-81db-2ff78ea5c1ee]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b1da16-bf39-4426-adcc-015e7841ba35]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] SCSI volumes sdi have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-72ecbd31-8e9a-4ba0-b99c-b2b3bae83da8 req-abe6fe35-59d1-4b70-b8c7-90a9cf449391 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-unplugged-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-72ecbd31-8e9a-4ba0-b99c-b2b3bae83da8 req-abe6fe35-59d1-4b70-b8c7-90a9cf449391 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-72ecbd31-8e9a-4ba0-b99c-b2b3bae83da8 req-abe6fe35-59d1-4b70-b8c7-90a9cf449391 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-72ecbd31-8e9a-4ba0-b99c-b2b3bae83da8 req-abe6fe35-59d1-4b70-b8c7-90a9cf449391 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-72ecbd31-8e9a-4ba0-b99c-b2b3bae83da8 req-abe6fe35-59d1-4b70-b8c7-90a9cf449391 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-unplugged-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-72ecbd31-8e9a-4ba0-b99c-b2b3bae83da8 req-abe6fe35-59d1-4b70-b8c7-90a9cf449391 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-unplugged-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cf8f3d-f2f1-425d-98a5-fcef1a29abb3]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-761f0efd-3e69-4d59-ae5b-6fe156d3fbb6 req-217b3236-84b7-4536-b5fd-2f5a80b19bde service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-unplugged-5f66c487-d522-409e-b066-9b0ae3da1bcb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-761f0efd-3e69-4d59-ae5b-6fe156d3fbb6 req-217b3236-84b7-4536-b5fd-2f5a80b19bde service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-761f0efd-3e69-4d59-ae5b-6fe156d3fbb6 req-217b3236-84b7-4536-b5fd-2f5a80b19bde service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-761f0efd-3e69-4d59-ae5b-6fe156d3fbb6 req-217b3236-84b7-4536-b5fd-2f5a80b19bde service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-761f0efd-3e69-4d59-ae5b-6fe156d3fbb6 req-217b3236-84b7-4536-b5fd-2f5a80b19bde service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-unplugged-5f66c487-d522-409e-b066-9b0ae3da1bcb {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-761f0efd-3e69-4d59-ae5b-6fe156d3fbb6 req-217b3236-84b7-4536-b5fd-2f5a80b19bde service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-unplugged-5f66c487-d522-409e-b066-9b0ae3da1bcb for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3077f25c-31b5-4b49-839b-f0050ddf9555]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260]
Apr 13 21:52:20 user nova-compute[71325]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260] successful.
Apr 13 21:52:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0d80d4-1cba-42ee-9515-896379637014]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== disconnect_volume: return (429ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-unplugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-unplugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:21 user nova-compute[71325]: WARNING nova.compute.manager [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-unplugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state active and task_state rebuilding.
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:21 user nova-compute[71325]: WARNING nova.compute.manager [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state active and task_state rebuilding.
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-unplugged-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-unplugged-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-unplugged-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:21 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance destroyed successfully.
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-968149372',display_name='tempest-ServerActionsTestJSON-server-1348347503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-968149372',id=14,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:48:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-p35kb61w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:52:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=c895d9cf-e6c1-42d6-88e3-1209b203fbe3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_vif [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03480082-c2, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:21 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Instance destroyed successfully.
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.objects.instance [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lazy-loading 'resources' on Instance uuid 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:e2:7c,bridge_name='br-int',has_traffic_filtering=True,id=24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2,network=Network(b84d8f07-7c73-4678-b29a-132f1a373d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b3ada6-d0') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:e2:7c,bridge_name='br-int',has_traffic_filtering=True,id=24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2,network=Network(b84d8f07-7c73-4678-b29a-132f1a373d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b3ada6-d0') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24b3ada6-d0, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:21 user nova-compute[71325]: INFO os_vif [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2')
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFsfLcoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:52:21 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7029ddce-8a3c-4339-ae04-51d7936d34fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:52:21 user nova-compute[71325]: No targets found.
Apr 13 21:52:21 user nova-compute[71325]: iSNS:
Apr 13 21:52:21 user nova-compute[71325]: No targets found.
Apr 13 21:52:21 user nova-compute[71325]: STATIC:
Apr 13 21:52:21 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d
Apr 13 21:52:21 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:21 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:21 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6
Apr 13 21:52:21 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:21 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:21 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763
Apr 13 21:52:21 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:21 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:21 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227
Apr 13 21:52:21 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:21 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:21 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:52:21 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:21 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:21 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12
Apr 13 21:52:21 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:21 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:21 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3
Apr 13 21:52:21 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:21 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:21 user nova-compute[71325]: FIRMWARE:
Apr 13 21:52:21 user nova-compute[71325]: No targets found.
Apr 13 21:52:21 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:52:21 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:52:21 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8763da-eea7-4638-9af9-3d814174d7a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:21 user nova-compute[71325]: INFO os_vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:e2:7c,bridge_name='br-int',has_traffic_filtering=True,id=24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2,network=Network(b84d8f07-7c73-4678-b29a-132f1a373d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b3ada6-d0')
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:d6:1b,bridge_name='br-int',has_traffic_filtering=True,id=5f66c487-d522-409e-b066-9b0ae3da1bcb,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f66c487-d5') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:d6:1b,bridge_name='br-int',has_traffic_filtering=True,id=5f66c487-d522-409e-b066-9b0ae3da1bcb,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f66c487-d5') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f66c487-d5, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd12040-e82f-4bf1-9c1c-825e021d5b9a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:52:21 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:21 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:21 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:21 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:21 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:21 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:21 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:52:21 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:21 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:21 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:21 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:21 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:21 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:21 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c4702710>, {}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Disconnecting from: [] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== disconnect_volume: return (91ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:52:21 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:52:21 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Deleting instance files /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3_del
Apr 13 21:52:21 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Deletion of /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3_del complete
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: INFO os_vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:d6:1b,bridge_name='br-int',has_traffic_filtering=True,id=5f66c487-d522-409e-b066-9b0ae3da1bcb,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f66c487-d5')
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9f:60,bridge_name='br-int',has_traffic_filtering=True,id=0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0e47caf0-d3') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9f:60,bridge_name='br-int',has_traffic_filtering=True,id=0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0e47caf0-d3') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e47caf0-d3, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:22 user nova-compute[71325]: INFO nova.virt.block_device [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Booting with volume 6c038cb0-7b1c-4305-97d8-318974560720 at /dev/vdb
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: INFO os_vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9f:60,bridge_name='br-int',has_traffic_filtering=True,id=0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0e47caf0-d3')
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "address": "fa:16:3e:b9:95:3c", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7587c8c4-a4", "ovs_interfaceid": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "address": "fa:16:3e:b9:95:3c", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7587c8c4-a4", "ovs_interfaceid": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:95:3c,bridge_name='br-int',has_traffic_filtering=True,id=7587c8c4-a480-4db1-be69-2e60fbd6e27b,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7587c8c4-a4') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:95:3c,bridge_name='br-int',has_traffic_filtering=True,id=7587c8c4-a480-4db1-be69-2e60fbd6e27b,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7587c8c4-a4') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7587c8c4-a4, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.utils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: INFO os_vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:95:3c,bridge_name='br-int',has_traffic_filtering=True,id=7587c8c4-a480-4db1-be69-2e60fbd6e27b,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7587c8c4-a4')
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5be52063-b3a4-42e7-ba9c-7791634309ac", "address": "fa:16:3e:a0:f4:f4", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5be52063-b3", "ovs_interfaceid": "5be52063-b3a4-42e7-ba9c-7791634309ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "5be52063-b3a4-42e7-ba9c-7791634309ac", "address": "fa:16:3e:a0:f4:f4", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5be52063-b3", "ovs_interfaceid": "5be52063-b3a4-42e7-ba9c-7791634309ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:f4:f4,bridge_name='br-int',has_traffic_filtering=True,id=5be52063-b3a4-42e7-ba9c-7791634309ac,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5be52063-b3') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:f4:f4,bridge_name='br-int',has_traffic_filtering=True,id=5be52063-b3a4-42e7-ba9c-7791634309ac,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5be52063-b3') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5be52063-b3, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9f3f4d-53bb-44af-8119-643be8a76aec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c9735a-4343-447f-a640-16b647282322]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: INFO os_vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:f4:f4,bridge_name='br-int',has_traffic_filtering=True,id=5be52063-b3a4-42e7-ba9c-7791634309ac,network=Network(e22c6f13-fe63-4ee1-9103-03c29ab563df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5be52063-b3')
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f031ddd-e857-4075-9b14-e71dd6581d72", "address": "fa:16:3e:7f:c6:93", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f031ddd-e8", "ovs_interfaceid": "9f031ddd-e857-4075-9b14-e71dd6581d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "9f031ddd-e857-4075-9b14-e71dd6581d72", "address": "fa:16:3e:7f:c6:93", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f031ddd-e8", "ovs_interfaceid": "9f031ddd-e857-4075-9b14-e71dd6581d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c6:93,bridge_name='br-int',has_traffic_filtering=True,id=9f031ddd-e857-4075-9b14-e71dd6581d72,network=Network(d1a760f7-e484-4699-85e9-3e88a9e4b7aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f031ddd-e8') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c6:93,bridge_name='br-int',has_traffic_filtering=True,id=9f031ddd-e857-4075-9b14-e71dd6581d72,network=Network(d1a760f7-e484-4699-85e9-3e88a9e4b7aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f031ddd-e8') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f031ddd-e8, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0d26c1-053b-4a7f-9e08-bcd6cc26f159]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f0bbc1-9c1a-471f-89d0-f306a9eeb741]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: INFO os_vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c6:93,bridge_name='br-int',has_traffic_filtering=True,id=9f031ddd-e857-4075-9b14-e71dd6581d72,network=Network(d1a760f7-e484-4699-85e9-3e88a9e4b7aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f031ddd-e8')
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1170693670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1170693670',id=17,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ==',key_name='tempest-keypair-398543526',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a2edca40d96494b8530f49a89dbd6e6',ramdisk_id='',reservation_id='r-2fi6vb77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-438641289',owner_user_name='tempest-TaggedBootDevicesTest_v242-438641289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331c3fa2628d466c9ae2729e269a5332',uuid=7905fecf-f246-4ed8-a5d4-9abdd3fb9cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "address": "fa:16:3e:e6:3d:82", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dfbfb87-41", "ovs_interfaceid": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converting VIF {"id": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "address": "fa:16:3e:e6:3d:82", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dfbfb87-41", "ovs_interfaceid": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3d:82,bridge_name='br-int',has_traffic_filtering=True,id=6dfbfb87-4182-4cef-b879-4e6cbbe7ed51,network=Network(d1a760f7-e484-4699-85e9-3e88a9e4b7aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dfbfb87-41') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3d:82,bridge_name='br-int',has_traffic_filtering=True,id=6dfbfb87-4182-4cef-b879-4e6cbbe7ed51,network=Network(d1a760f7-e484-4699-85e9-3e88a9e4b7aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dfbfb87-41') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:52:22 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[314aac63-fa23-4673-af5d-811de3d5b7a1]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.utils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating existing volume attachment record: 87a285eb-c1fd-4232-b08f-13d03e155e00 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6dfbfb87-41, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:22 user nova-compute[71325]: INFO os_vif [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3d:82,bridge_name='br-int',has_traffic_filtering=True,id=6dfbfb87-4182-4cef-b879-4e6cbbe7ed51,network=Network(d1a760f7-e484-4699-85e9-3e88a9e4b7aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dfbfb87-41')
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSKNHQEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:52:22 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3fcef2-9849-47a0-a973-6cadb35a1cf6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:52:22 user nova-compute[71325]: No targets found.
Apr 13 21:52:22 user nova-compute[71325]: iSNS:
Apr 13 21:52:22 user nova-compute[71325]: No targets found.
Apr 13 21:52:22 user nova-compute[71325]: STATIC:
Apr 13 21:52:22 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d
Apr 13 21:52:22 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:22 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:22 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6
Apr 13 21:52:22 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:22 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:22 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763
Apr 13 21:52:22 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:22 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:22 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227
Apr 13 21:52:22 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:22 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:22 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:52:22 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:22 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:22 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12
Apr 13 21:52:22 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:22 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:22 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3
Apr 13 21:52:22 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:22 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:22 user nova-compute[71325]: FIRMWARE:
Apr 13 21:52:22 user nova-compute[71325]: No targets found.
Apr 13 21:52:22 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:52:22 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:52:22 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[079e5c43-8884-47d9-a43c-f440485b8532]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6593e44-cf14-4fc0-84c4-d49647039db1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:22 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:22 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d4bb6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6'): ({'sdc'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Removing single pathed devices sdc {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc04fe9-bc12-4e87-868e-8c0bd59e5b26]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[106c87cf-1920-4d5f-b938-4aade193a4cb]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Flushing IO for device /dev/sdc {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c940bbe-17ea-4766-b44f-2a2b0eb6aec5]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5d951c-0aa6-4342-8843-21bf1b386225]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:22 user nova-compute[71325]: WARNING nova.compute.manager [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 for instance with vm_state active and task_state deleting.
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-unplugged-9f031ddd-e857-4075-9b14-e71dd6581d72 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-unplugged-9f031ddd-e857-4075-9b14-e71dd6581d72 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-unplugged-9f031ddd-e857-4075-9b14-e71dd6581d72 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-9f031ddd-e857-4075-9b14-e71dd6581d72 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-9f031ddd-e857-4075-9b14-e71dd6581d72 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:22 user nova-compute[71325]: WARNING nova.compute.manager [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-9f031ddd-e857-4075-9b14-e71dd6581d72 for instance with vm_state active and task_state deleting.
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e446d55-f26d-43ed-8193-9679238fa6b4]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-5f66c487-d522-409e-b066-9b0ae3da1bcb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-5f66c487-d522-409e-b066-9b0ae3da1bcb {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:22 user nova-compute[71325]: WARNING nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-5f66c487-d522-409e-b066-9b0ae3da1bcb for instance with vm_state active and task_state deleting.
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-unplugged-0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-unplugged-0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-unplugged-0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:22 user nova-compute[71325]: WARNING nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac for instance with vm_state active and task_state deleting.
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-unplugged-7587c8c4-a480-4db1-be69-2e60fbd6e27b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-unplugged-7587c8c4-a480-4db1-be69-2e60fbd6e27b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-unplugged-7587c8c4-a480-4db1-be69-2e60fbd6e27b for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-7587c8c4-a480-4db1-be69-2e60fbd6e27b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-7587c8c4-a480-4db1-be69-2e60fbd6e27b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:22 user nova-compute[71325]: WARNING nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-7587c8c4-a480-4db1-be69-2e60fbd6e27b for instance with vm_state active and task_state deleting.
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-unplugged-5be52063-b3a4-42e7-ba9c-7791634309ac {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-unplugged-5be52063-b3a4-42e7-ba9c-7791634309ac {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-unplugged-5be52063-b3a4-42e7-ba9c-7791634309ac for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[63516464-2ab6-40fa-a797-916e4f439e0f]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6, portal: 172.16.0.220,3260]
Apr 13 21:52:22 user nova-compute[71325]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6, portal: 172.16.0.220,3260] successful.
Apr 13 21:52:22 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d4c6a-2de6-4848-8c15-d7cd841bafd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d44cb6-ce77-445d-99ba-cfce5c984de7]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] <== disconnect_volume: return (376ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TWHtJKmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:52:22 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1915c7cc-b8b2-41ff-b7c2-5f5ef13b1763]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:52:22 user nova-compute[71325]: No targets found.
Apr 13 21:52:22 user nova-compute[71325]: iSNS:
Apr 13 21:52:22 user nova-compute[71325]: No targets found.
Apr 13 21:52:22 user nova-compute[71325]: STATIC:
Apr 13 21:52:22 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d
Apr 13 21:52:22 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:22 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:22 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763
Apr 13 21:52:22 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:22 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:22 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227
Apr 13 21:52:22 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:22 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:22 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:52:22 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:22 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:22 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12
Apr 13 21:52:22 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:22 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:22 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3
Apr 13 21:52:22 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:22 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:22 user nova-compute[71325]: FIRMWARE:
Apr 13 21:52:22 user nova-compute[71325]: No targets found.
Apr 13 21:52:22 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:52:22 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:52:22 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6757ec-c6c2-443e-a60e-5aac4b7b19db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5911828d-12fa-42c9-a45c-61ed25c3a491]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:22 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:22 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:22 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7e1fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12'): ({'sdf'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Removing single pathed devices sdf {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca42b1cb-60a4-46bc-9857-dd8728977fa7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f08b790-e693-4889-8fa8-a3da4c915cf7]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Flushing IO for device /dev/sdf {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcebc03-8ded-41cc-83bd-354b0706c2de]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a8136c-ea04-4bdb-9130-59be460a5cf3]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] SCSI volumes sdf have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b02d53-8d7d-4973-83ba-e1f694c9d82b]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d0ceee-020e-43c2-b5c8-4a9f2928ed79]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12, portal: 172.16.0.220,3260]
Apr 13 21:52:23 user nova-compute[71325]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12, portal: 172.16.0.220,3260] successful.
Apr 13 21:52:23 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3610f8-edc3-44d8-8282-e0da72d4ef12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[293b4367-be8e-49a2-bf8a-47ad6615ca14]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] <== disconnect_volume: return (337ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zkoJBlyE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:52:23 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[205204a5-a4f2-4158-b143-49b55a54f1f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:52:23 user nova-compute[71325]: No targets found.
Apr 13 21:52:23 user nova-compute[71325]: iSNS:
Apr 13 21:52:23 user nova-compute[71325]: No targets found.
Apr 13 21:52:23 user nova-compute[71325]: STATIC:
Apr 13 21:52:23 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d
Apr 13 21:52:23 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:23 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:23 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763
Apr 13 21:52:23 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:23 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:23 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227
Apr 13 21:52:23 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:23 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:23 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:52:23 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:23 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:23 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3
Apr 13 21:52:23 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:23 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:23 user nova-compute[71325]: FIRMWARE:
Apr 13 21:52:23 user nova-compute[71325]: No targets found.
Apr 13 21:52:23 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:52:23 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:52:23 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fd8663-ba5f-4b1f-9846-6667d1a5ef02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e583dade-ee7e-415b-95c8-27be2cabac61]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:23 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:23 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:23 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:23 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:23 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 (non-flash)
Apr 13 21:52:23 user nova-compute[71325]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:23 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:23 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:23 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:23 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c42ffb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3'): ({'sdg'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Removing single pathed devices sdg {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bd8044-fcd5-4722-90f4-8b5cc957fe6b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f0b9ed-ac39-4191-a0ec-310be04f4d22]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Flushing IO for device /dev/sdg {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG nova.compute.manager [req-8ccf8007-90a7-424c-8361-954a0e6847ec req-8793d2b1-777d-4cef-b3bd-35da2eba6932 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8ccf8007-90a7-424c-8361-954a0e6847ec req-8793d2b1-777d-4cef-b3bd-35da2eba6932 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8ccf8007-90a7-424c-8361-954a0e6847ec req-8793d2b1-777d-4cef-b3bd-35da2eba6932 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8ccf8007-90a7-424c-8361-954a0e6847ec req-8793d2b1-777d-4cef-b3bd-35da2eba6932 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG nova.compute.manager [req-8ccf8007-90a7-424c-8361-954a0e6847ec req-8793d2b1-777d-4cef-b3bd-35da2eba6932 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:23 user nova-compute[71325]: WARNING nova.compute.manager [req-8ccf8007-90a7-424c-8361-954a0e6847ec req-8793d2b1-777d-4cef-b3bd-35da2eba6932 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 for instance with vm_state active and task_state deleting.
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[25671bcd-29c8-45c4-8099-f0d7ea6d0ee5]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ae3ec3-0bc3-4bac-8b7a-a106dd1b43d3]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] SCSI volumes sdg have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[445bb133-9285-489a-9329-dbdc83ad2326]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a0e548-daca-4b1b-9905-e329799d646f]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3, portal: 172.16.0.220,3260]
Apr 13 21:52:23 user nova-compute[71325]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3, portal: 172.16.0.220,3260] successful.
Apr 13 21:52:23 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0989634-7097-4ab3-9e8a-4d49e6953fb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1f97fa-4fe6-4f81-ab2c-7dcd0328d59d]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] <== disconnect_volume: return (336ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:52:23 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Deleting instance files /opt/stack/data/nova/instances/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac_del
Apr 13 21:52:23 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Deletion of /opt/stack/data/nova/instances/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac_del complete
Apr 13 21:52:23 user nova-compute[71325]: INFO nova.compute.manager [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Took 3.47 seconds to destroy the instance on the hypervisor.
Apr 13 21:52:23 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:52:23 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:52:24 user nova-compute[71325]: DEBUG nova.compute.manager [req-aca1dfe7-b064-44c4-8de3-4f5a4e25fec4 req-d5227b88-e605-4d63-ade3-f78a1c4608a5 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-plugged-5be52063-b3a4-42e7-ba9c-7791634309ac {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aca1dfe7-b064-44c4-8de3-4f5a4e25fec4 req-d5227b88-e605-4d63-ade3-f78a1c4608a5 service nova] Acquiring lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aca1dfe7-b064-44c4-8de3-4f5a4e25fec4 req-d5227b88-e605-4d63-ade3-f78a1c4608a5 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aca1dfe7-b064-44c4-8de3-4f5a4e25fec4 req-d5227b88-e605-4d63-ade3-f78a1c4608a5 service nova] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:24 user nova-compute[71325]: DEBUG nova.compute.manager [req-aca1dfe7-b064-44c4-8de3-4f5a4e25fec4 req-d5227b88-e605-4d63-ade3-f78a1c4608a5 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] No waiting events found dispatching network-vif-plugged-5be52063-b3a4-42e7-ba9c-7791634309ac {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:24 user nova-compute[71325]: WARNING nova.compute.manager [req-aca1dfe7-b064-44c4-8de3-4f5a4e25fec4 req-d5227b88-e605-4d63-ade3-f78a1c4608a5 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received unexpected event network-vif-plugged-5be52063-b3a4-42e7-ba9c-7791634309ac for instance with vm_state active and task_state deleting.
Apr 13 21:52:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:25 user nova-compute[71325]: DEBUG nova.compute.manager [req-834643fc-40d9-4879-bc00-e9ef0377b928 req-83236e71-1e9d-4030-9a1a-6ade115dcf9c service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-deleted-6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:25 user nova-compute[71325]: INFO nova.compute.manager [req-834643fc-40d9-4879-bc00-e9ef0377b928 req-83236e71-1e9d-4030-9a1a-6ade115dcf9c service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Neutron deleted interface 6dfbfb87-4182-4cef-b879-4e6cbbe7ed51; detaching it from the instance and deleting it from the info cache
Apr 13 21:52:25 user nova-compute[71325]: DEBUG nova.network.neutron [req-834643fc-40d9-4879-bc00-e9ef0377b928 req-83236e71-1e9d-4030-9a1a-6ade115dcf9c service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [{"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "address": "fa:16:3e:b9:95:3c", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7587c8c4-a4", "ovs_interfaceid": "7587c8c4-a480-4db1-be69-2e60fbd6e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5be52063-b3a4-42e7-ba9c-7791634309ac", "address": "fa:16:3e:a0:f4:f4", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5be52063-b3", "ovs_interfaceid": "5be52063-b3a4-42e7-ba9c-7791634309ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f031ddd-e857-4075-9b14-e71dd6581d72", "address": "fa:16:3e:7f:c6:93", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f031ddd-e8", "ovs_interfaceid": "9f031ddd-e857-4075-9b14-e71dd6581d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:25 user nova-compute[71325]: DEBUG nova.compute.manager [req-834643fc-40d9-4879-bc00-e9ef0377b928 req-83236e71-1e9d-4030-9a1a-6ade115dcf9c service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Detach interface failed, port_id=6dfbfb87-4182-4cef-b879-4e6cbbe7ed51, reason: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:52:27 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Creating image(s)
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "/opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "/opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "/opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk 1073741824" returned: 0 in 0.058s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Cannot resize image /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Ensure instance console log exists: /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Start _get_guest_xml network_info=[{"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFsfLcoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c895d9cf-e6c1-42d6-88e3-1209b203fbe3', 'attached_at': '', 'detached_at': '', 'volume_id': '6c038cb0-7b1c-4305-97d8-318974560720', 'serial': '6c038cb0-7b1c-4305-97d8-318974560720'}, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '87a285eb-c1fd-4232-b08f-13d03e155e00', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:52:27 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 13 21:52:27 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'vcpu_model' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFsfLcoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:52:27 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 21:52:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:52:27 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 21:52:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:52:27 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-deleted-7587c8c4-a480-4db1-be69-2e60fbd6e27b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:27 user nova-compute[71325]: INFO nova.compute.manager [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Neutron deleted interface 7587c8c4-a480-4db1-be69-2e60fbd6e27b; detaching it from the instance and deleting it from the info cache
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.network.neutron [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [{"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5be52063-b3a4-42e7-ba9c-7791634309ac", "address": "fa:16:3e:a0:f4:f4", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5be52063-b3", "ovs_interfaceid": "5be52063-b3a4-42e7-ba9c-7791634309ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f031ddd-e857-4075-9b14-e71dd6581d72", "address": "fa:16:3e:7f:c6:93", "network": {"id": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1259930891", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f031ddd-e8", "ovs_interfaceid": "9f031ddd-e857-4075-9b14-e71dd6581d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0a3a92-6588-4a12-be63-780f9b799372]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:52:27 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Detach interface failed, port_id=7587c8c4-a480-4db1-be69-2e60fbd6e27b, reason: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-deleted-9f031ddd-e857-4075-9b14-e71dd6581d72 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:27 user nova-compute[71325]: INFO nova.compute.manager [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Neutron deleted interface 9f031ddd-e857-4075-9b14-e71dd6581d72; detaching it from the instance and deleting it from the info cache
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.network.neutron [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [{"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5be52063-b3a4-42e7-ba9c-7791634309ac", "address": "fa:16:3e:a0:f4:f4", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5be52063-b3", "ovs_interfaceid": "5be52063-b3a4-42e7-ba9c-7791634309ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd49bdd0-541f-45ee-85d7-369eff502b06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720] added
Apr 13 21:52:27 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:27 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Took 4.42 seconds to deallocate network for instance.
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2c81b6-4c5f-44b3-aac4-10343b7549d3]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Detach interface failed, port_id=9f031ddd-e857-4075-9b14-e71dd6581d72, reason: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-deleted-5be52063-b3a4-42e7-ba9c-7791634309ac {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:27 user nova-compute[71325]: INFO nova.compute.manager [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Neutron deleted interface 5be52063-b3a4-42e7-ba9c-7791634309ac; detaching it from the instance and deleting it from the info cache
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.network.neutron [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [{"id": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "address": "fa:16:3e:69:e2:7c", "network": {"id": "b84d8f07-7c73-4678-b29a-132f1a373d9a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2118049485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b3ada6-d0", "ovs_interfaceid": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d3e569-1bd7-4c4a-bf74-ba7d1251dbae]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFsfLcoj {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Detach interface failed, port_id=5be52063-b3a4-42e7-ba9c-7791634309ac, reason: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFsfLcoj" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd63e88-48d2-42da-8bb8-eebcd468ed41]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eFsfLcoj'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ada8021-db3d-429f-a7d8-0323a4b55ed1]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7305783d-ab9c-46b2-ba59-a44a696920b0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:28 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:28 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:28 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:28 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:28 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:28 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:28 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:28 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d02a50-ff80-4d63-ad1f-5817c4775a15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260]
Apr 13 21:52:28 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260] successful.
Apr 13 21:52:28 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bc819c-d24c-4809-82a2-f3093eb3070a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[81386666-3a58-4241-84e6-b98e33ef50b3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:28 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:28 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:28 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:28 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:52:28 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:28 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:28 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:28 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:28 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:52:28 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b80781f-7c3f-48de-88ea-32d8207a5889]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:52:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFsfLcoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26463363934663764', 'path': '/dev/sdc'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463363934663764', 'path': '/dev/sdc'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-968149372',display_name='tempest-ServerActionsTestJSON-server-1348347503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-968149372',id=14,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:48:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-p35kb61w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:52:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=c895d9cf-e6c1-42d6-88e3-1209b203fbe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:52:29 user nova-compute[71325]:   <uuid>c895d9cf-e6c1-42d6-88e3-1209b203fbe3</uuid>
Apr 13 21:52:29 user nova-compute[71325]:   <name>instance-0000000e</name>
Apr 13 21:52:29 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:52:29 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:52:29 user nova-compute[71325]:   <metadata>
Apr 13 21:52:29 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:52:29 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:52:29 user nova-compute[71325]:       <nova:name>tempest-ServerActionsTestJSON-server-1348347503</nova:name>
Apr 13 21:52:29 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:52:27</nova:creationTime>
Apr 13 21:52:29 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:52:29 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:52:29 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:52:29 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:52:29 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:52:29 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:52:29 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:52:29 user nova-compute[71325]:       <nova:owner>
Apr 13 21:52:29 user nova-compute[71325]:         <nova:user uuid="b3db8b01a05b43f68bfd8695253514db">tempest-ServerActionsTestJSON-236976022-project-member</nova:user>
Apr 13 21:52:29 user nova-compute[71325]:         <nova:project uuid="7c086cffbafb4da68f172ab27da232d3">tempest-ServerActionsTestJSON-236976022</nova:project>
Apr 13 21:52:29 user nova-compute[71325]:       </nova:owner>
Apr 13 21:52:29 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:52:29 user nova-compute[71325]:       <nova:ports>
Apr 13 21:52:29 user nova-compute[71325]:         <nova:port uuid="03480082-c22f-4ad9-bc15-d536f115ec88">
Apr 13 21:52:29 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 21:52:29 user nova-compute[71325]:         </nova:port>
Apr 13 21:52:29 user nova-compute[71325]:       </nova:ports>
Apr 13 21:52:29 user nova-compute[71325]:     </nova:instance>
Apr 13 21:52:29 user nova-compute[71325]:   </metadata>
Apr 13 21:52:29 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:52:29 user nova-compute[71325]:     <system>
Apr 13 21:52:29 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:52:29 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:52:29 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:52:29 user nova-compute[71325]:       <entry name="serial">c895d9cf-e6c1-42d6-88e3-1209b203fbe3</entry>
Apr 13 21:52:29 user nova-compute[71325]:       <entry name="uuid">c895d9cf-e6c1-42d6-88e3-1209b203fbe3</entry>
Apr 13 21:52:29 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:52:29 user nova-compute[71325]:     </system>
Apr 13 21:52:29 user nova-compute[71325]:   </sysinfo>
Apr 13 21:52:29 user nova-compute[71325]:   <os>
Apr 13 21:52:29 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:52:29 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:52:29 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:52:29 user nova-compute[71325]:   </os>
Apr 13 21:52:29 user nova-compute[71325]:   <features>
Apr 13 21:52:29 user nova-compute[71325]:     <acpi/>
Apr 13 21:52:29 user nova-compute[71325]:     <apic/>
Apr 13 21:52:29 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:52:29 user nova-compute[71325]:   </features>
Apr 13 21:52:29 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:52:29 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:52:29 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:52:29 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:52:29 user nova-compute[71325]:   </clock>
Apr 13 21:52:29 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:52:29 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:52:29 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:52:29 user nova-compute[71325]:   </cpu>
Apr 13 21:52:29 user nova-compute[71325]:   <devices>
Apr 13 21:52:29 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:52:29 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:52:29 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk"/>
Apr 13 21:52:29 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:52:29 user nova-compute[71325]:     </disk>
Apr 13 21:52:29 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:52:29 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:52:29 user nova-compute[71325]:       <source dev="/dev/sdc"/>
Apr 13 21:52:29 user nova-compute[71325]:       <target dev="vdb" bus="virtio"/>
Apr 13 21:52:29 user nova-compute[71325]:       <serial>6c038cb0-7b1c-4305-97d8-318974560720</serial>
Apr 13 21:52:29 user nova-compute[71325]:     </disk>
Apr 13 21:52:29 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:52:29 user nova-compute[71325]:       <mac address="fa:16:3e:ef:31:9d"/>
Apr 13 21:52:29 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:52:29 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:52:29 user nova-compute[71325]:       <target dev="tap03480082-c2"/>
Apr 13 21:52:29 user nova-compute[71325]:     </interface>
Apr 13 21:52:29 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:52:29 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/console.log" append="off"/>
Apr 13 21:52:29 user nova-compute[71325]:     </serial>
Apr 13 21:52:29 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:52:29 user nova-compute[71325]:     <video>
Apr 13 21:52:29 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:52:29 user nova-compute[71325]:     </video>
Apr 13 21:52:29 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:52:29 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:52:29 user nova-compute[71325]:     </rng>
Apr 13 21:52:29 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:52:29 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:52:29 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:52:29 user nova-compute[71325]:     </memballoon>
Apr 13 21:52:29 user nova-compute[71325]:   </devices>
Apr 13 21:52:29 user nova-compute[71325]: </domain>
Apr 13 21:52:29 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-968149372',display_name='tempest-ServerActionsTestJSON-server-1348347503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-968149372',id=14,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:48:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-p35kb61w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:52:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=c895d9cf-e6c1-42d6-88e3-1209b203fbe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG os_vif [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03480082-c2, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03480082-c2, col_values=(('external_ids', {'iface-id': '03480082-c22f-4ad9-bc15-d536f115ec88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:31:9d', 'vm-uuid': 'c895d9cf-e6c1-42d6-88e3-1209b203fbe3'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:29 user nova-compute[71325]: INFO os_vif [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2')
Apr 13 21:52:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No VIF found with MAC fa:16:3e:ef:31:9d, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG nova.compute.manager [req-e866d669-825b-4e5d-9d54-109bac343c8e req-75f0adf1-d2c5-447a-bf31-e0369aa41648 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Received event network-vif-deleted-24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:29 user nova-compute[71325]: INFO nova.compute.manager [req-e866d669-825b-4e5d-9d54-109bac343c8e req-75f0adf1-d2c5-447a-bf31-e0369aa41648 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Neutron deleted interface 24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2; detaching it from the instance and deleting it from the info cache
Apr 13 21:52:29 user nova-compute[71325]: DEBUG nova.network.neutron [req-e866d669-825b-4e5d-9d54-109bac343c8e req-75f0adf1-d2c5-447a-bf31-e0369aa41648 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Updating instance_info_cache with network_info: [{"id": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "address": "fa:16:3e:10:d6:1b", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f66c487-d5", "ovs_interfaceid": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "address": "fa:16:3e:e1:9f:60", "network": {"id": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "bridge": "br-int", "label": "tempest-device-tagging-net1-2099926254", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8a2edca40d96494b8530f49a89dbd6e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e47caf0-d3", "ovs_interfaceid": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:29 user nova-compute[71325]: DEBUG nova.compute.manager [req-e866d669-825b-4e5d-9d54-109bac343c8e req-75f0adf1-d2c5-447a-bf31-e0369aa41648 service nova] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Detach interface failed, port_id=24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2, reason: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:52:30 user nova-compute[71325]: INFO nova.compute.manager [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Took 2.73 seconds to detach 3 volumes for instance.
Apr 13 21:52:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "03554793-01dd-4629-97c7-b640f5934639" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:30 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.128s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:52:31 user nova-compute[71325]: INFO nova.compute.claims [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Claim successful on node user
Apr 13 21:52:31 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Deleted allocations for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac
Apr 13 21:52:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.421s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:31 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:52:32 user nova-compute[71325]: INFO nova.compute.manager [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Terminating instance
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:32 user nova-compute[71325]: WARNING nova.compute.manager [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state active and task_state rebuild_spawning.
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:32 user nova-compute[71325]: WARNING nova.compute.manager [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state active and task_state rebuild_spawning.
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.869s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.network.neutron [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:52:32 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:52:32 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Creating image(s)
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "/opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "/opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "/opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "502ccd16d3bfb133912734663f744e9ed0d9bcf0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "502ccd16d3bfb133912734663f744e9ed0d9bcf0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.policy [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0.part --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:32 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Instance destroyed successfully.
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.objects.instance [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'resources' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1586666894',display_name='tempest-ServerStableDeviceRescueTest-server-1586666894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1586666894',id=7,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEyy8lvN5JxTozYg9ByYCQUUKEcNGunFuCkWcpXFzcQgw9m/DW6nJHXR8e8LkSDM7KZy5/LgblZ7q8T1OTnPbj9wKvTJ0iV6fPco0NWPjXLrW2GtaHDcybWSGRNToUsWA==',key_name='tempest-keypair-1172830782',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:49:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4235a17cc95422dacb6386d4952fc8e',ramdisk_id='',reservation_id='r-z7lko0o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1552707388',owner_user_name='tempest-ServerStableDeviceRescueTest-1552707388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c1bbf573ea436293abf4debdecc515',uuid=af4efbd5-a4c1-4e7c-b274-92413f86f2a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Converting VIF {"id": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "address": "fa:16:3e:f2:21:5b", "network": {"id": "7401a99a-44e9-442d-8f64-8591e14e8388", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098590396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4235a17cc95422dacb6386d4952fc8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a7bc69-be", "ovs_interfaceid": "f0a7bc69-be17-49d2-94fc-40541afce8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=f0a7bc69-be17-49d2-94fc-40541afce8ed,network=Network(7401a99a-44e9-442d-8f64-8591e14e8388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a7bc69-be') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG os_vif [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=f0a7bc69-be17-49d2-94fc-40541afce8ed,network=Network(7401a99a-44e9-442d-8f64-8591e14e8388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a7bc69-be') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0a7bc69-be, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:32 user nova-compute[71325]: INFO os_vif [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=f0a7bc69-be17-49d2-94fc-40541afce8ed,network=Network(7401a99a-44e9-442d-8f64-8591e14e8388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a7bc69-be')
Apr 13 21:52:32 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Deleting instance files /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8_del
Apr 13 21:52:32 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Deletion of /opt/stack/data/nova/instances/af4efbd5-a4c1-4e7c-b274-92413f86f2a8_del complete
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0.part --force-share --output=json" returned: 0 in 0.192s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.virt.images [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 8d241d02-be9d-4e4d-b10c-ab4729e58ff8 was qcow2, converting to raw {{(pid=71325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:52:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0.part /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0.converted {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:33 user nova-compute[71325]: INFO nova.compute.manager [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Took 1.04 seconds to destroy the instance on the hypervisor.
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0.part /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0.converted" returned: 0 in 0.199s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0.converted --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "502ccd16d3bfb133912734663f744e9ed0d9bcf0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.926s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0 --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "502ccd16d3bfb133912734663f744e9ed0d9bcf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "502ccd16d3bfb133912734663f744e9ed0d9bcf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.network.neutron [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Successfully created port: 0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for c895d9cf-e6c1-42d6-88e3-1209b203fbe3 due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422753.6593065, c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:52:33 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] VM Resumed (Lifecycle Event)
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.compute.manager [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:52:33 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance spawned successfully.
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0 --force-share --output=json" returned: 0 in 0.168s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0,backing_fmt=raw /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0,backing_fmt=raw /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk 1073741824" returned: 0 in 0.067s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "502ccd16d3bfb133912734663f744e9ed0d9bcf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:33 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422753.6609478, c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:52:33 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] VM Started (Lifecycle Event)
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:52:33 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0 --force-share --output=json" returned: 0 in 0.163s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:33 user nova-compute[71325]: DEBUG nova.compute.manager [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71325) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Cannot resize image /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.objects.instance [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'migration_context' on Instance uuid 03554793-01dd-4629-97c7-b640f5934639 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Ensure instance console log exists: /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-vif-unplugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] No waiting events found dispatching network-vif-unplugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-vif-unplugged-f0a7bc69-be17-49d2-94fc-40541afce8ed for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] Acquiring lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] No waiting events found dispatching network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:34 user nova-compute[71325]: WARNING nova.compute.manager [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received unexpected event network-vif-plugged-f0a7bc69-be17-49d2-94fc-40541afce8ed for instance with vm_state active and task_state deleting.
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.140s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-32609aed-3fb3-4b64-a174-25dc415126f5 req-e897967f-04f8-4c73-a0ac-4fb1e498a521 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Received event network-vif-deleted-f0a7bc69-be17-49d2-94fc-40541afce8ed {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:34 user nova-compute[71325]: INFO nova.compute.manager [req-32609aed-3fb3-4b64-a174-25dc415126f5 req-e897967f-04f8-4c73-a0ac-4fb1e498a521 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Neutron deleted interface f0a7bc69-be17-49d2-94fc-40541afce8ed; detaching it from the instance and deleting it from the info cache
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.network.neutron [req-32609aed-3fb3-4b64-a174-25dc415126f5 req-e897967f-04f8-4c73-a0ac-4fb1e498a521 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:34 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Took 1.27 seconds to deallocate network for instance.
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-32609aed-3fb3-4b64-a174-25dc415126f5 req-e897967f-04f8-4c73-a0ac-4fb1e498a521 service nova] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Detach interface failed, port_id=f0a7bc69-be17-49d2-94fc-40541afce8ed, reason: Instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.network.neutron [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Successfully updated port: 0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquired lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.network.neutron [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.network.neutron [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:34 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Deleted allocations for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8
Apr 13 21:52:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "af4efbd5-a4c1-4e7c-b274-92413f86f2a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.962s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.network.neutron [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Updating instance_info_cache with network_info: [{"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Releasing lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Instance network_info: |[{"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Start _get_guest_xml network_info=[{"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:52:27Z,direct_url=<?>,disk_format='qcow2',id=8d241d02-be9d-4e4d-b10c-ab4729e58ff8,min_disk=0,min_ram=0,name='tempest-scenario-img--696509611',owner='7d4e8c27ff7d4fa9a61e000c9d02c5f4',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:52:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '8d241d02-be9d-4e4d-b10c-ab4729e58ff8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:52:35 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:52:35 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:52:27Z,direct_url=<?>,disk_format='qcow2',id=8d241d02-be9d-4e4d-b10c-ab4729e58ff8,min_disk=0,min_ram=0,name='tempest-scenario-img--696509611',owner='7d4e8c27ff7d4fa9a61e000c9d02c5f4',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:52:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:52:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-808147313',display_name='tempest-TestMinimumBasicScenario-server-808147313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-808147313',id=20,image_ref='8d241d02-be9d-4e4d-b10c-ab4729e58ff8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFchKKqHuC1A8TVFkKSWtfAOCeALfKG5uYpEQTwmP5PX7R4ATfyOZxxZVyd+GOJywfIC+zr0Ar04FqfPo8XD9N72V5J7q/z2PYiROQQ6v4nThfjKvGI9C5bEr2NM1HThiA==',key_name='tempest-TestMinimumBasicScenario-636650613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d4e8c27ff7d4fa9a61e000c9d02c5f4',ramdisk_id='',reservation_id='r-x0tgbjv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d241d02-be9d-4e4d-b10c-ab4729e58ff8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1800545339',owner_user_name='tempest-TestMinimumBasicScenario-1800545339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:52:32Z,user_data=None,user_id='710e0446cf794e94b3ab29bb0d7e10d8',uuid=03554793-01dd-4629-97c7-b640f5934639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converting VIF {"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:fe:50,bridge_name='br-int',has_traffic_filtering=True,id=0150fcfb-793e-4d51-966c-c30195a9802f,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0150fcfb-79') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.objects.instance [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'pci_devices' on Instance uuid 03554793-01dd-4629-97c7-b640f5934639 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:52:35 user nova-compute[71325]:   <uuid>03554793-01dd-4629-97c7-b640f5934639</uuid>
Apr 13 21:52:35 user nova-compute[71325]:   <name>instance-00000014</name>
Apr 13 21:52:35 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:52:35 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:52:35 user nova-compute[71325]:   <metadata>
Apr 13 21:52:35 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:52:35 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:52:35 user nova-compute[71325]:       <nova:name>tempest-TestMinimumBasicScenario-server-808147313</nova:name>
Apr 13 21:52:35 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:52:35</nova:creationTime>
Apr 13 21:52:35 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:52:35 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:52:35 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:52:35 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:52:35 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:52:35 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:52:35 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:52:35 user nova-compute[71325]:       <nova:owner>
Apr 13 21:52:35 user nova-compute[71325]:         <nova:user uuid="710e0446cf794e94b3ab29bb0d7e10d8">tempest-TestMinimumBasicScenario-1800545339-project-member</nova:user>
Apr 13 21:52:35 user nova-compute[71325]:         <nova:project uuid="7d4e8c27ff7d4fa9a61e000c9d02c5f4">tempest-TestMinimumBasicScenario-1800545339</nova:project>
Apr 13 21:52:35 user nova-compute[71325]:       </nova:owner>
Apr 13 21:52:35 user nova-compute[71325]:       <nova:root type="image" uuid="8d241d02-be9d-4e4d-b10c-ab4729e58ff8"/>
Apr 13 21:52:35 user nova-compute[71325]:       <nova:ports>
Apr 13 21:52:35 user nova-compute[71325]:         <nova:port uuid="0150fcfb-793e-4d51-966c-c30195a9802f">
Apr 13 21:52:35 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 21:52:35 user nova-compute[71325]:         </nova:port>
Apr 13 21:52:35 user nova-compute[71325]:       </nova:ports>
Apr 13 21:52:35 user nova-compute[71325]:     </nova:instance>
Apr 13 21:52:35 user nova-compute[71325]:   </metadata>
Apr 13 21:52:35 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:52:35 user nova-compute[71325]:     <system>
Apr 13 21:52:35 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:52:35 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:52:35 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:52:35 user nova-compute[71325]:       <entry name="serial">03554793-01dd-4629-97c7-b640f5934639</entry>
Apr 13 21:52:35 user nova-compute[71325]:       <entry name="uuid">03554793-01dd-4629-97c7-b640f5934639</entry>
Apr 13 21:52:35 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:52:35 user nova-compute[71325]:     </system>
Apr 13 21:52:35 user nova-compute[71325]:   </sysinfo>
Apr 13 21:52:35 user nova-compute[71325]:   <os>
Apr 13 21:52:35 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:52:35 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:52:35 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:52:35 user nova-compute[71325]:   </os>
Apr 13 21:52:35 user nova-compute[71325]:   <features>
Apr 13 21:52:35 user nova-compute[71325]:     <acpi/>
Apr 13 21:52:35 user nova-compute[71325]:     <apic/>
Apr 13 21:52:35 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:52:35 user nova-compute[71325]:   </features>
Apr 13 21:52:35 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:52:35 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:52:35 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:52:35 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:52:35 user nova-compute[71325]:   </clock>
Apr 13 21:52:35 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:52:35 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:52:35 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:52:35 user nova-compute[71325]:   </cpu>
Apr 13 21:52:35 user nova-compute[71325]:   <devices>
Apr 13 21:52:35 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:52:35 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:52:35 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk"/>
Apr 13 21:52:35 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:52:35 user nova-compute[71325]:     </disk>
Apr 13 21:52:35 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:52:35 user nova-compute[71325]:       <mac address="fa:16:3e:63:fe:50"/>
Apr 13 21:52:35 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:52:35 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:52:35 user nova-compute[71325]:       <target dev="tap0150fcfb-79"/>
Apr 13 21:52:35 user nova-compute[71325]:     </interface>
Apr 13 21:52:35 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:52:35 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/console.log" append="off"/>
Apr 13 21:52:35 user nova-compute[71325]:     </serial>
Apr 13 21:52:35 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:52:35 user nova-compute[71325]:     <video>
Apr 13 21:52:35 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:52:35 user nova-compute[71325]:     </video>
Apr 13 21:52:35 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:52:35 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:52:35 user nova-compute[71325]:     </rng>
Apr 13 21:52:35 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:52:35 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:52:35 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:52:35 user nova-compute[71325]:     </memballoon>
Apr 13 21:52:35 user nova-compute[71325]:   </devices>
Apr 13 21:52:35 user nova-compute[71325]: </domain>
Apr 13 21:52:35 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:52:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-808147313',display_name='tempest-TestMinimumBasicScenario-server-808147313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-808147313',id=20,image_ref='8d241d02-be9d-4e4d-b10c-ab4729e58ff8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFchKKqHuC1A8TVFkKSWtfAOCeALfKG5uYpEQTwmP5PX7R4ATfyOZxxZVyd+GOJywfIC+zr0Ar04FqfPo8XD9N72V5J7q/z2PYiROQQ6v4nThfjKvGI9C5bEr2NM1HThiA==',key_name='tempest-TestMinimumBasicScenario-636650613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d4e8c27ff7d4fa9a61e000c9d02c5f4',ramdisk_id='',reservation_id='r-x0tgbjv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d241d02-be9d-4e4d-b10c-ab4729e58ff8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1800545339',owner_user_name='tempest-TestMinimumBasicScenario-1800545339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:52:32Z,user_data=None,user_id='710e0446cf794e94b3ab29bb0d7e10d8',uuid=03554793-01dd-4629-97c7-b640f5934639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converting VIF {"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:fe:50,bridge_name='br-int',has_traffic_filtering=True,id=0150fcfb-793e-4d51-966c-c30195a9802f,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0150fcfb-79') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG os_vif [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:fe:50,bridge_name='br-int',has_traffic_filtering=True,id=0150fcfb-793e-4d51-966c-c30195a9802f,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0150fcfb-79') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0150fcfb-79, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0150fcfb-79, col_values=(('external_ids', {'iface-id': '0150fcfb-793e-4d51-966c-c30195a9802f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:fe:50', 'vm-uuid': '03554793-01dd-4629-97c7-b640f5934639'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:35 user nova-compute[71325]: INFO os_vif [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:fe:50,bridge_name='br-int',has_traffic_filtering=True,id=0150fcfb-793e-4d51-966c-c30195a9802f,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0150fcfb-79')
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:52:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] No VIF found with MAC fa:16:3e:63:fe:50, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-102e58f1-cebd-45ce-9e57-6f3f59293b35 req-3f6ea9b9-93ee-4fd9-9599-e95b0532102b service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-changed-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-102e58f1-cebd-45ce-9e57-6f3f59293b35 req-3f6ea9b9-93ee-4fd9-9599-e95b0532102b service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Refreshing instance network info cache due to event network-changed-0150fcfb-793e-4d51-966c-c30195a9802f. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-102e58f1-cebd-45ce-9e57-6f3f59293b35 req-3f6ea9b9-93ee-4fd9-9599-e95b0532102b service nova] Acquiring lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-102e58f1-cebd-45ce-9e57-6f3f59293b35 req-3f6ea9b9-93ee-4fd9-9599-e95b0532102b service nova] Acquired lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-102e58f1-cebd-45ce-9e57-6f3f59293b35 req-3f6ea9b9-93ee-4fd9-9599-e95b0532102b service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Refreshing network info cache for port 0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-a3da7dda-c3f6-4ba0-bd7b-dd073e298276 req-dde314b9-56e6-43ef-9ebd-fa1fb1b74f82 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-changed-2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-a3da7dda-c3f6-4ba0-bd7b-dd073e298276 req-dde314b9-56e6-43ef-9ebd-fa1fb1b74f82 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing instance network info cache due to event network-changed-2ade8fab-1fde-4730-aacc-fcb3b613c402. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a3da7dda-c3f6-4ba0-bd7b-dd073e298276 req-dde314b9-56e6-43ef-9ebd-fa1fb1b74f82 service nova] Acquiring lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a3da7dda-c3f6-4ba0-bd7b-dd073e298276 req-dde314b9-56e6-43ef-9ebd-fa1fb1b74f82 service nova] Acquired lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-a3da7dda-c3f6-4ba0-bd7b-dd073e298276 req-dde314b9-56e6-43ef-9ebd-fa1fb1b74f82 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Refreshing network info cache for port 2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422741.7339258, 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:52:36 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] VM Stopped (Lifecycle Event)
Apr 13 21:52:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG nova.compute.manager [None req-ef473e15-3db4-4d61-a162-e8dea2a97023 None None] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-102e58f1-cebd-45ce-9e57-6f3f59293b35 req-3f6ea9b9-93ee-4fd9-9599-e95b0532102b service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Updated VIF entry in instance network info cache for port 0150fcfb-793e-4d51-966c-c30195a9802f. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-102e58f1-cebd-45ce-9e57-6f3f59293b35 req-3f6ea9b9-93ee-4fd9-9599-e95b0532102b service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Updating instance_info_cache with network_info: [{"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-102e58f1-cebd-45ce-9e57-6f3f59293b35 req-3f6ea9b9-93ee-4fd9-9599-e95b0532102b service nova] Releasing lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:37 user nova-compute[71325]: INFO nova.compute.manager [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Terminating instance
Apr 13 21:52:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-a3da7dda-c3f6-4ba0-bd7b-dd073e298276 req-dde314b9-56e6-43ef-9ebd-fa1fb1b74f82 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updated VIF entry in instance network info cache for port 2ade8fab-1fde-4730-aacc-fcb3b613c402. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-a3da7dda-c3f6-4ba0-bd7b-dd073e298276 req-dde314b9-56e6-43ef-9ebd-fa1fb1b74f82 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating instance_info_cache with network_info: [{"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "address": "fa:16:3e:4c:f4:41", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e50a64-fb", "ovs_interfaceid": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "address": "fa:16:3e:ba:07:e0", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca8e06e-e9", "ovs_interfaceid": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38028ec5-f65f-44d7-a8f8-bc4470278334", "address": "fa:16:3e:f3:61:4c", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38028ec5-f6", "ovs_interfaceid": "38028ec5-f65f-44d7-a8f8-bc4470278334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a3da7dda-c3f6-4ba0-bd7b-dd073e298276 req-dde314b9-56e6-43ef-9ebd-fa1fb1b74f82 service nova] Releasing lock "refresh_cache-f16c661a-6f38-43fe-a801-a69de6e687ea" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-da6fd88a-58fc-4168-84bd-049c8a147f4d req-84446084-e399-4d3a-bf99-8d8d114c848d service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-unplugged-2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-da6fd88a-58fc-4168-84bd-049c8a147f4d req-84446084-e399-4d3a-bf99-8d8d114c848d service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-da6fd88a-58fc-4168-84bd-049c8a147f4d req-84446084-e399-4d3a-bf99-8d8d114c848d service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-da6fd88a-58fc-4168-84bd-049c8a147f4d req-84446084-e399-4d3a-bf99-8d8d114c848d service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-da6fd88a-58fc-4168-84bd-049c8a147f4d req-84446084-e399-4d3a-bf99-8d8d114c848d service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-unplugged-2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-da6fd88a-58fc-4168-84bd-049c8a147f4d req-84446084-e399-4d3a-bf99-8d8d114c848d service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-unplugged-2ade8fab-1fde-4730-aacc-fcb3b613c402 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] No waiting events found dispatching network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:38 user nova-compute[71325]: WARNING nova.compute.manager [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received unexpected event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f for instance with vm_state building and task_state spawning.
Apr 13 21:52:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] No waiting events found dispatching network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:38 user nova-compute[71325]: WARNING nova.compute.manager [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received unexpected event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f for instance with vm_state building and task_state spawning.
Apr 13 21:52:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-unplugged-75e50a64-fb53-4613-b7b5-3cc00b4b9458 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-unplugged-75e50a64-fb53-4613-b7b5-3cc00b4b9458 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-unplugged-75e50a64-fb53-4613-b7b5-3cc00b4b9458 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Instance destroyed successfully.
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.objects.instance [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lazy-loading 'resources' on Instance uuid f16c661a-6f38-43fe-a801-a69de6e687ea {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:51:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c6:3b,bridge_name='br-int',has_traffic_filtering=True,id=2ade8fab-1fde-4730-aacc-fcb3b613c402,network=Network(912df412-2f07-4668-8db3-bbcfced5fb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ade8fab-1f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c6:3b,bridge_name='br-int',has_traffic_filtering=True,id=2ade8fab-1fde-4730-aacc-fcb3b613c402,network=Network(912df412-2f07-4668-8db3-bbcfced5fb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ade8fab-1f') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ade8fab-1f, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: INFO os_vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c6:3b,bridge_name='br-int',has_traffic_filtering=True,id=2ade8fab-1fde-4730-aacc-fcb3b613c402,network=Network(912df412-2f07-4668-8db3-bbcfced5fb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ade8fab-1f')
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:51:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:3c:03,bridge_name='br-int',has_traffic_filtering=True,id=079a7af6-43b0-4f03-a24a-b54d0e9a1c89,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap079a7af6-43') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:3c:03,bridge_name='br-int',has_traffic_filtering=True,id=079a7af6-43b0-4f03-a24a-b54d0e9a1c89,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap079a7af6-43') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap079a7af6-43, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: INFO os_vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:3c:03,bridge_name='br-int',has_traffic_filtering=True,id=079a7af6-43b0-4f03-a24a-b54d0e9a1c89,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap079a7af6-43')
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:51:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:91:74,bridge_name='br-int',has_traffic_filtering=True,id=7062c9f1-5719-4d6b-8b6a-efbb377c078b,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7062c9f1-57') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:91:74,bridge_name='br-int',has_traffic_filtering=True,id=7062c9f1-5719-4d6b-8b6a-efbb377c078b,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7062c9f1-57') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7062c9f1-57, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: INFO os_vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:91:74,bridge_name='br-int',has_traffic_filtering=True,id=7062c9f1-5719-4d6b-8b6a-efbb377c078b,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7062c9f1-57')
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:51:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "address": "fa:16:3e:4c:f4:41", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e50a64-fb", "ovs_interfaceid": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "address": "fa:16:3e:4c:f4:41", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e50a64-fb", "ovs_interfaceid": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:41,bridge_name='br-int',has_traffic_filtering=True,id=75e50a64-fb53-4613-b7b5-3cc00b4b9458,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e50a64-fb') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:41,bridge_name='br-int',has_traffic_filtering=True,id=75e50a64-fb53-4613-b7b5-3cc00b4b9458,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e50a64-fb') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75e50a64-fb, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: INFO os_vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:41,bridge_name='br-int',has_traffic_filtering=True,id=75e50a64-fb53-4613-b7b5-3cc00b4b9458,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e50a64-fb')
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:51:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "address": "fa:16:3e:ba:07:e0", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca8e06e-e9", "ovs_interfaceid": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "address": "fa:16:3e:ba:07:e0", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca8e06e-e9", "ovs_interfaceid": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:07:e0,bridge_name='br-int',has_traffic_filtering=True,id=0ca8e06e-e964-4815-b2d8-a6c3fef7bf75,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca8e06e-e9') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:07:e0,bridge_name='br-int',has_traffic_filtering=True,id=0ca8e06e-e964-4815-b2d8-a6c3fef7bf75,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca8e06e-e9') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ca8e06e-e9, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: INFO os_vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:07:e0,bridge_name='br-int',has_traffic_filtering=True,id=0ca8e06e-e964-4815-b2d8-a6c3fef7bf75,network=Network(50ae5f56-7e00-4798-80bb-bf7a925e1f39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca8e06e-e9')
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:51:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ee:a8,bridge_name='br-int',has_traffic_filtering=True,id=f239b75b-16b7-4fcd-b3e3-d65f10278c43,network=Network(b0bd1140-dadc-4c14-940a-3b35313e6e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf239b75b-16') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ee:a8,bridge_name='br-int',has_traffic_filtering=True,id=f239b75b-16b7-4fcd-b3e3-d65f10278c43,network=Network(b0bd1140-dadc-4c14-940a-3b35313e6e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf239b75b-16') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422759.513613, 03554793-01dd-4629-97c7-b640f5934639 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:52:39 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] VM Resumed (Lifecycle Event)
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf239b75b-16, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:39 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 03554793-01dd-4629-97c7-b640f5934639] Instance spawned successfully.
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:52:39 user nova-compute[71325]: INFO os_vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ee:a8,bridge_name='br-int',has_traffic_filtering=True,id=f239b75b-16b7-4fcd-b3e3-d65f10278c43,network=Network(b0bd1140-dadc-4c14-940a-3b35313e6e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf239b75b-16')
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T21:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535284063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535284063',id=18,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew==',key_name='tempest-keypair-113663637',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:51:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f969510e1734ad4bf48a8c0a3d7ae8f',ramdisk_id='',reservation_id='r-yyx08mfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1783658683',owner_user_name='tempest-TaggedBootDevicesTest-1783658683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2446d7b79d7f4879ab857ab6a10777aa',uuid=f16c661a-6f38-43fe-a801-a69de6e687ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38028ec5-f65f-44d7-a8f8-bc4470278334", "address": "fa:16:3e:f3:61:4c", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38028ec5-f6", "ovs_interfaceid": "38028ec5-f65f-44d7-a8f8-bc4470278334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converting VIF {"id": "38028ec5-f65f-44d7-a8f8-bc4470278334", "address": "fa:16:3e:f3:61:4c", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38028ec5-f6", "ovs_interfaceid": "38028ec5-f65f-44d7-a8f8-bc4470278334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:61:4c,bridge_name='br-int',has_traffic_filtering=True,id=38028ec5-f65f-44d7-a8f8-bc4470278334,network=Network(b0bd1140-dadc-4c14-940a-3b35313e6e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38028ec5-f6') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:61:4c,bridge_name='br-int',has_traffic_filtering=True,id=38028ec5-f65f-44d7-a8f8-bc4470278334,network=Network(b0bd1140-dadc-4c14-940a-3b35313e6e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38028ec5-f6') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38028ec5-f6, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:39 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422759.5163753, 03554793-01dd-4629-97c7-b640f5934639 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:52:39 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] VM Started (Lifecycle Event)
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:39 user nova-compute[71325]: WARNING nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-2ade8fab-1fde-4730-aacc-fcb3b613c402 for instance with vm_state active and task_state deleting.
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-unplugged-079a7af6-43b0-4f03-a24a-b54d0e9a1c89 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-unplugged-079a7af6-43b0-4f03-a24a-b54d0e9a1c89 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-unplugged-079a7af6-43b0-4f03-a24a-b54d0e9a1c89 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-079a7af6-43b0-4f03-a24a-b54d0e9a1c89 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-079a7af6-43b0-4f03-a24a-b54d0e9a1c89 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:39 user nova-compute[71325]: WARNING nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-079a7af6-43b0-4f03-a24a-b54d0e9a1c89 for instance with vm_state active and task_state deleting.
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-unplugged-7062c9f1-5719-4d6b-8b6a-efbb377c078b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-unplugged-7062c9f1-5719-4d6b-8b6a-efbb377c078b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-unplugged-7062c9f1-5719-4d6b-8b6a-efbb377c078b for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-7062c9f1-5719-4d6b-8b6a-efbb377c078b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-7062c9f1-5719-4d6b-8b6a-efbb377c078b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:39 user nova-compute[71325]: WARNING nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-7062c9f1-5719-4d6b-8b6a-efbb377c078b for instance with vm_state active and task_state deleting.
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-unplugged-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-unplugged-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-unplugged-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:39 user nova-compute[71325]: WARNING nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 for instance with vm_state active and task_state deleting.
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-unplugged-f239b75b-16b7-4fcd-b3e3-d65f10278c43 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-unplugged-f239b75b-16b7-4fcd-b3e3-d65f10278c43 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-unplugged-f239b75b-16b7-4fcd-b3e3-d65f10278c43 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:39 user nova-compute[71325]: INFO os_vif [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:61:4c,bridge_name='br-int',has_traffic_filtering=True,id=38028ec5-f65f-44d7-a8f8-bc4470278334,network=Network(b0bd1140-dadc-4c14-940a-3b35313e6e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38028ec5-f6')
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PlZARHQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:52:39 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:52:39 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:39 user nova-compute[71325]: INFO nova.compute.manager [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Took 7.25 seconds to spawn the instance on the hypervisor.
Apr 13 21:52:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f3697c-befa-484e-a7b8-d1b41a974213]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:52:39 user nova-compute[71325]: No targets found.
Apr 13 21:52:39 user nova-compute[71325]: iSNS:
Apr 13 21:52:39 user nova-compute[71325]: No targets found.
Apr 13 21:52:39 user nova-compute[71325]: STATIC:
Apr 13 21:52:39 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d
Apr 13 21:52:39 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:39 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:39 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720
Apr 13 21:52:39 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:39 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:39 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763
Apr 13 21:52:39 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:39 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:39 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227
Apr 13 21:52:39 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:39 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:39 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:52:39 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:39 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:39 user nova-compute[71325]: FIRMWARE:
Apr 13 21:52:39 user nova-compute[71325]: No targets found.
Apr 13 21:52:39 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:52:39 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:52:39 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1313c3bd-f6f7-4fed-9ec1-d7eb6135bcc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b63b147-23ff-4581-8b4d-7e3fec69ae37]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:39 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:39 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:39 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:39 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:52:39 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 (non-flash)
Apr 13 21:52:39 user nova-compute[71325]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:39 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:39 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:39 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:52:39 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c44d5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:39 user nova-compute[71325]: INFO nova.compute.manager [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Took 8.74 seconds to build instance.
Apr 13 21:52:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f7056a-b2c5-43b8-81d5-6c66c70ef925]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "03554793-01dd-4629-97c7-b640f5934639" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.908s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a3913f-f436-41b7-83b6-417a9975722e]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af385a5-67d0-4b9e-9777-317cda67babd]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f436566-8057-417f-81a7-e099d1fefbdf]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f24df8b-08dd-4cbf-b908-decd78222a1b]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[613274e9-adbf-4a29-8710-fc6b99fd4b4d]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763, portal: 172.16.0.220,3260]
Apr 13 21:52:40 user nova-compute[71325]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763, portal: 172.16.0.220,3260] successful.
Apr 13 21:52:40 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5cba55-94c2-4da0-9227-07704d15f763 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c915d25d-df5f-4106-962f-aa3508efada8]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] <== disconnect_volume: return (386ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FzEpRfIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:52:40 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3554037-c7d4-4407-942a-9943951744f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:52:40 user nova-compute[71325]: No targets found.
Apr 13 21:52:40 user nova-compute[71325]: iSNS:
Apr 13 21:52:40 user nova-compute[71325]: No targets found.
Apr 13 21:52:40 user nova-compute[71325]: STATIC:
Apr 13 21:52:40 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d
Apr 13 21:52:40 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:40 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:40 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720
Apr 13 21:52:40 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:40 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:40 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227
Apr 13 21:52:40 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:40 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:40 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:52:40 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:40 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:40 user nova-compute[71325]: FIRMWARE:
Apr 13 21:52:40 user nova-compute[71325]: No targets found.
Apr 13 21:52:40 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:52:40 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:52:40 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea3a6b3-254f-4045-a6a8-a4ef2993d1b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c21f425-e332-45df-aaaf-ee9f4accfcf8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:40 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:40 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:40 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:52:40 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 (non-flash)
Apr 13 21:52:40 user nova-compute[71325]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:40 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:40 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:52:40 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c44d7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227'): ({'sde'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Removing single pathed devices sde {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d14982-4c55-4021-8e08-b3bed3bb9f6d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec784f9f-77b3-4356-a9b2-80b5ea7eed43]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Flushing IO for device /dev/sde {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c994af-3ff6-4a40-96a6-dce62355e39a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[33547ee0-d7df-4783-ba8d-ea2b5e70a2d2]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] SCSI volumes sde have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dd6c64-fb07-42c2-b90c-de9dd2aa8bfd]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a990dad-7b4f-44a2-bc70-7298f042d042]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227, portal: 172.16.0.220,3260]
Apr 13 21:52:40 user nova-compute[71325]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227, portal: 172.16.0.220,3260] successful.
Apr 13 21:52:40 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d1ab68-19d7-42ea-95eb-ce2536260227 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[783bfcab-21f0-489c-83c1-7dc769520ccd]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] <== disconnect_volume: return (392ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxYGgNku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:52:40 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[956bca2e-35af-44ea-b8f8-5fa34e0bdba0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:52:40 user nova-compute[71325]: No targets found.
Apr 13 21:52:40 user nova-compute[71325]: iSNS:
Apr 13 21:52:40 user nova-compute[71325]: No targets found.
Apr 13 21:52:40 user nova-compute[71325]: STATIC:
Apr 13 21:52:40 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d
Apr 13 21:52:40 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:40 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:40 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720
Apr 13 21:52:40 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:40 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:40 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:52:40 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:52:40 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:52:40 user nova-compute[71325]: FIRMWARE:
Apr 13 21:52:40 user nova-compute[71325]: No targets found.
Apr 13 21:52:40 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:52:40 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:52:40 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-be3c16b5-ab19-482b-9c53-7ff39b2abce3 req-9a4ca994-3d38-4150-ba02-cb271c243488 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-75e50a64-fb53-4613-b7b5-3cc00b4b9458 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-be3c16b5-ab19-482b-9c53-7ff39b2abce3 req-9a4ca994-3d38-4150-ba02-cb271c243488 service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-be3c16b5-ab19-482b-9c53-7ff39b2abce3 req-9a4ca994-3d38-4150-ba02-cb271c243488 service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-be3c16b5-ab19-482b-9c53-7ff39b2abce3 req-9a4ca994-3d38-4150-ba02-cb271c243488 service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-be3c16b5-ab19-482b-9c53-7ff39b2abce3 req-9a4ca994-3d38-4150-ba02-cb271c243488 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-75e50a64-fb53-4613-b7b5-3cc00b4b9458 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:40 user nova-compute[71325]: WARNING nova.compute.manager [req-be3c16b5-ab19-482b-9c53-7ff39b2abce3 req-9a4ca994-3d38-4150-ba02-cb271c243488 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-75e50a64-fb53-4613-b7b5-3cc00b4b9458 for instance with vm_state active and task_state deleting.
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebb4300-868f-4b86-8ec1-ed10c32aec15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc3b128-5911-4f17-a317-5c9e9ecf95df]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:40 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:40 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:52:40 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d (non-flash)
Apr 13 21:52:40 user nova-compute[71325]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:52:40 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:52:40 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7e8ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d'): ({'sdh'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Removing single pathed devices sdh {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[854c3e07-3cdc-4419-bb66-53833c15eb6e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b66059-f4e3-42ce-a0c8-807a09b7f44b]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Flushing IO for device /dev/sdh {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[86846882-5d93-4e50-bfe3-8d9a7b147168]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c60505f-94d7-44e7-abdb-0c19f9831874]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] SCSI volumes sdh have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f940f06-7dd3-497e-8631-355b17df811c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f431b9b3-f281-4db4-b276-c7cee6e51b43]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d, portal: 172.16.0.220,3260]
Apr 13 21:52:40 user nova-compute[71325]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d, portal: 172.16.0.220,3260] successful.
Apr 13 21:52:40 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915905d4-b167-4222-8664-66f1072c4d4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d3c6f2-b332-4ac1-95be-7f6ad2e17ee8]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] <== disconnect_volume: return (338ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:52:40 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Deleting instance files /opt/stack/data/nova/instances/f16c661a-6f38-43fe-a801-a69de6e687ea_del
Apr 13 21:52:40 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Deletion of /opt/stack/data/nova/instances/f16c661a-6f38-43fe-a801-a69de6e687ea_del complete
Apr 13 21:52:40 user nova-compute[71325]: INFO nova.compute.manager [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Took 3.78 seconds to destroy the instance on the hypervisor.
Apr 13 21:52:40 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:52:40 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:52:41 user nova-compute[71325]: INFO nova.compute.claims [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Claim successful on node user
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-f239b75b-16b7-4fcd-b3e3-d65f10278c43 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-f239b75b-16b7-4fcd-b3e3-d65f10278c43 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:41 user nova-compute[71325]: WARNING nova.compute.manager [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-f239b75b-16b7-4fcd-b3e3-d65f10278c43 for instance with vm_state active and task_state deleting.
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-unplugged-38028ec5-f65f-44d7-a8f8-bc4470278334 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-unplugged-38028ec5-f65f-44d7-a8f8-bc4470278334 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-unplugged-38028ec5-f65f-44d7-a8f8-bc4470278334 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-plugged-38028ec5-f65f-44d7-a8f8-bc4470278334 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Acquiring lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] No waiting events found dispatching network-vif-plugged-38028ec5-f65f-44d7-a8f8-bc4470278334 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:41 user nova-compute[71325]: WARNING nova.compute.manager [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received unexpected event network-vif-plugged-38028ec5-f65f-44d7-a8f8-bc4470278334 for instance with vm_state active and task_state deleting.
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:52:41 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:52:41 user nova-compute[71325]: DEBUG nova.policy [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:52:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Creating image(s)
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "/opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "/opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk 1073741824" returned: 0 in 0.068s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.194s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Successfully created port: 596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Cannot resize image /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG nova.objects.instance [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'migration_context' on Instance uuid 2d1990a1-40ec-4c02-941f-813c22e8cd8f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Ensure instance console log exists: /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-39ccadce-ca81-48c3-a96d-28eb718bd937 req-1585367a-379c-4e47-ad5d-c8e63f633a95 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-deleted-0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:42 user nova-compute[71325]: INFO nova.compute.manager [req-39ccadce-ca81-48c3-a96d-28eb718bd937 req-1585367a-379c-4e47-ad5d-c8e63f633a95 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Neutron deleted interface 0ca8e06e-e964-4815-b2d8-a6c3fef7bf75; detaching it from the instance and deleting it from the info cache
Apr 13 21:52:42 user nova-compute[71325]: DEBUG nova.network.neutron [req-39ccadce-ca81-48c3-a96d-28eb718bd937 req-1585367a-379c-4e47-ad5d-c8e63f633a95 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating instance_info_cache with network_info: [{"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "address": "fa:16:3e:4c:f4:41", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e50a64-fb", "ovs_interfaceid": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38028ec5-f65f-44d7-a8f8-bc4470278334", "address": "fa:16:3e:f3:61:4c", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38028ec5-f6", "ovs_interfaceid": "38028ec5-f65f-44d7-a8f8-bc4470278334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-39ccadce-ca81-48c3-a96d-28eb718bd937 req-1585367a-379c-4e47-ad5d-c8e63f633a95 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Detach interface failed, port_id=0ca8e06e-e964-4815-b2d8-a6c3fef7bf75, reason: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:52:43 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Successfully updated port: 596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:52:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:52:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquired lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:52:43 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-301fe951-fbff-4c18-b174-eb5c6356cee2 req-0d283891-41d1-45cc-8ba7-44ef826540d8 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received event network-changed-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-301fe951-fbff-4c18-b174-eb5c6356cee2 req-0d283891-41d1-45cc-8ba7-44ef826540d8 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Refreshing instance network info cache due to event network-changed-596fdd61-68e0-4968-9d6a-e70d32a61ea1. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-301fe951-fbff-4c18-b174-eb5c6356cee2 req-0d283891-41d1-45cc-8ba7-44ef826540d8 service nova] Acquiring lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Updating instance_info_cache with network_info: [{"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Releasing lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Instance network_info: |[{"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-301fe951-fbff-4c18-b174-eb5c6356cee2 req-0d283891-41d1-45cc-8ba7-44ef826540d8 service nova] Acquired lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.network.neutron [req-301fe951-fbff-4c18-b174-eb5c6356cee2 req-0d283891-41d1-45cc-8ba7-44ef826540d8 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Refreshing network info cache for port 596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Start _get_guest_xml network_info=[{"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:52:44 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:52:44 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1709500779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1709500779',id=21,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXhPPymVnGsGI8iPnkTaRKfPT/rUDm48QkxOPI6ZWHXQz9atCTXJ29rrIJZqJqbdFj0MEal6JqZMkPR7ZgeYnFdlqc8HBwjKnYEiOmGpjFVUDqtFqGBgnihI4QoBsFC8Q==',key_name='tempest-keypair-1268128451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73c23bc3e8b14441b4622095502b5dae',ramdisk_id='',reservation_id='r-j68sz1ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-710815470',owner_user_name='tempest-AttachVolumeShelveTestJSON-710815470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:52:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f151b673e3d47acb9c3ed9b9ecaf687',uuid=2d1990a1-40ec-4c02-941f-813c22e8cd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converting VIF {"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:f3,bridge_name='br-int',has_traffic_filtering=True,id=596fdd61-68e0-4968-9d6a-e70d32a61ea1,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596fdd61-68') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.objects.instance [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d1990a1-40ec-4c02-941f-813c22e8cd8f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:52:44 user nova-compute[71325]:   <uuid>2d1990a1-40ec-4c02-941f-813c22e8cd8f</uuid>
Apr 13 21:52:44 user nova-compute[71325]:   <name>instance-00000015</name>
Apr 13 21:52:44 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:52:44 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:52:44 user nova-compute[71325]:   <metadata>
Apr 13 21:52:44 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:52:44 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:52:44 user nova-compute[71325]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1709500779</nova:name>
Apr 13 21:52:44 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:52:44</nova:creationTime>
Apr 13 21:52:44 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:52:44 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:52:44 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:52:44 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:52:44 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:52:44 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:52:44 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:52:44 user nova-compute[71325]:       <nova:owner>
Apr 13 21:52:44 user nova-compute[71325]:         <nova:user uuid="3f151b673e3d47acb9c3ed9b9ecaf687">tempest-AttachVolumeShelveTestJSON-710815470-project-member</nova:user>
Apr 13 21:52:44 user nova-compute[71325]:         <nova:project uuid="73c23bc3e8b14441b4622095502b5dae">tempest-AttachVolumeShelveTestJSON-710815470</nova:project>
Apr 13 21:52:44 user nova-compute[71325]:       </nova:owner>
Apr 13 21:52:44 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:52:44 user nova-compute[71325]:       <nova:ports>
Apr 13 21:52:44 user nova-compute[71325]:         <nova:port uuid="596fdd61-68e0-4968-9d6a-e70d32a61ea1">
Apr 13 21:52:44 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 21:52:44 user nova-compute[71325]:         </nova:port>
Apr 13 21:52:44 user nova-compute[71325]:       </nova:ports>
Apr 13 21:52:44 user nova-compute[71325]:     </nova:instance>
Apr 13 21:52:44 user nova-compute[71325]:   </metadata>
Apr 13 21:52:44 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:52:44 user nova-compute[71325]:     <system>
Apr 13 21:52:44 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:52:44 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:52:44 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:52:44 user nova-compute[71325]:       <entry name="serial">2d1990a1-40ec-4c02-941f-813c22e8cd8f</entry>
Apr 13 21:52:44 user nova-compute[71325]:       <entry name="uuid">2d1990a1-40ec-4c02-941f-813c22e8cd8f</entry>
Apr 13 21:52:44 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:52:44 user nova-compute[71325]:     </system>
Apr 13 21:52:44 user nova-compute[71325]:   </sysinfo>
Apr 13 21:52:44 user nova-compute[71325]:   <os>
Apr 13 21:52:44 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:52:44 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:52:44 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:52:44 user nova-compute[71325]:   </os>
Apr 13 21:52:44 user nova-compute[71325]:   <features>
Apr 13 21:52:44 user nova-compute[71325]:     <acpi/>
Apr 13 21:52:44 user nova-compute[71325]:     <apic/>
Apr 13 21:52:44 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:52:44 user nova-compute[71325]:   </features>
Apr 13 21:52:44 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:52:44 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:52:44 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:52:44 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:52:44 user nova-compute[71325]:   </clock>
Apr 13 21:52:44 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:52:44 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:52:44 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:52:44 user nova-compute[71325]:   </cpu>
Apr 13 21:52:44 user nova-compute[71325]:   <devices>
Apr 13 21:52:44 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:52:44 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:52:44 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk"/>
Apr 13 21:52:44 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:52:44 user nova-compute[71325]:     </disk>
Apr 13 21:52:44 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:52:44 user nova-compute[71325]:       <mac address="fa:16:3e:38:35:f3"/>
Apr 13 21:52:44 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:52:44 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:52:44 user nova-compute[71325]:       <target dev="tap596fdd61-68"/>
Apr 13 21:52:44 user nova-compute[71325]:     </interface>
Apr 13 21:52:44 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:52:44 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/console.log" append="off"/>
Apr 13 21:52:44 user nova-compute[71325]:     </serial>
Apr 13 21:52:44 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:52:44 user nova-compute[71325]:     <video>
Apr 13 21:52:44 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:52:44 user nova-compute[71325]:     </video>
Apr 13 21:52:44 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:52:44 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:52:44 user nova-compute[71325]:     </rng>
Apr 13 21:52:44 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:52:44 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:52:44 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:52:44 user nova-compute[71325]:     </memballoon>
Apr 13 21:52:44 user nova-compute[71325]:   </devices>
Apr 13 21:52:44 user nova-compute[71325]: </domain>
Apr 13 21:52:44 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1709500779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1709500779',id=21,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXhPPymVnGsGI8iPnkTaRKfPT/rUDm48QkxOPI6ZWHXQz9atCTXJ29rrIJZqJqbdFj0MEal6JqZMkPR7ZgeYnFdlqc8HBwjKnYEiOmGpjFVUDqtFqGBgnihI4QoBsFC8Q==',key_name='tempest-keypair-1268128451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73c23bc3e8b14441b4622095502b5dae',ramdisk_id='',reservation_id='r-j68sz1ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-710815470',owner_user_name='tempest-AttachVolumeShelveTestJSON-710815470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:52:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f151b673e3d47acb9c3ed9b9ecaf687',uuid=2d1990a1-40ec-4c02-941f-813c22e8cd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converting VIF {"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:f3,bridge_name='br-int',has_traffic_filtering=True,id=596fdd61-68e0-4968-9d6a-e70d32a61ea1,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596fdd61-68') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG os_vif [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:f3,bridge_name='br-int',has_traffic_filtering=True,id=596fdd61-68e0-4968-9d6a-e70d32a61ea1,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596fdd61-68') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap596fdd61-68, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap596fdd61-68, col_values=(('external_ids', {'iface-id': '596fdd61-68e0-4968-9d6a-e70d32a61ea1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:35:f3', 'vm-uuid': '2d1990a1-40ec-4c02-941f-813c22e8cd8f'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:44 user nova-compute[71325]: INFO os_vif [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:f3,bridge_name='br-int',has_traffic_filtering=True,id=596fdd61-68e0-4968-9d6a-e70d32a61ea1,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596fdd61-68')
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] No VIF found with MAC fa:16:3e:38:35:f3, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-deleted-38028ec5-f65f-44d7-a8f8-bc4470278334 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:44 user nova-compute[71325]: INFO nova.compute.manager [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Neutron deleted interface 38028ec5-f65f-44d7-a8f8-bc4470278334; detaching it from the instance and deleting it from the info cache
Apr 13 21:52:44 user nova-compute[71325]: DEBUG nova.network.neutron [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating instance_info_cache with network_info: [{"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "address": "fa:16:3e:4c:f4:41", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e50a64-fb", "ovs_interfaceid": "75e50a64-fb53-4613-b7b5-3cc00b4b9458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:45 user nova-compute[71325]: DEBUG nova.compute.manager [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Detach interface failed, port_id=38028ec5-f65f-44d7-a8f8-bc4470278334, reason: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:52:45 user nova-compute[71325]: DEBUG nova.compute.manager [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-deleted-75e50a64-fb53-4613-b7b5-3cc00b4b9458 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:45 user nova-compute[71325]: INFO nova.compute.manager [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Neutron deleted interface 75e50a64-fb53-4613-b7b5-3cc00b4b9458; detaching it from the instance and deleting it from the info cache
Apr 13 21:52:45 user nova-compute[71325]: DEBUG nova.network.neutron [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating instance_info_cache with network_info: [{"id": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "address": "fa:16:3e:4c:c6:3b", "network": {"id": "912df412-2f07-4668-8db3-bbcfced5fb5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1448869163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ade8fab-1f", "ovs_interfaceid": "2ade8fab-1fde-4730-aacc-fcb3b613c402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:45 user nova-compute[71325]: DEBUG nova.compute.manager [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Detach interface failed, port_id=75e50a64-fb53-4613-b7b5-3cc00b4b9458, reason: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:52:45 user nova-compute[71325]: DEBUG nova.compute.manager [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-deleted-2ade8fab-1fde-4730-aacc-fcb3b613c402 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:45 user nova-compute[71325]: INFO nova.compute.manager [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Neutron deleted interface 2ade8fab-1fde-4730-aacc-fcb3b613c402; detaching it from the instance and deleting it from the info cache
Apr 13 21:52:45 user nova-compute[71325]: DEBUG nova.network.neutron [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating instance_info_cache with network_info: [{"id": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "address": "fa:16:3e:ab:3c:03", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079a7af6-43", "ovs_interfaceid": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "address": "fa:16:3e:60:91:74", "network": {"id": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1262144832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7062c9f1-57", "ovs_interfaceid": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "address": "fa:16:3e:7b:ee:a8", "network": {"id": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "bridge": "br-int", "label": "tempest-device-tagging-net2-788040497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1f969510e1734ad4bf48a8c0a3d7ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf239b75b-16", "ovs_interfaceid": "f239b75b-16b7-4fcd-b3e3-d65f10278c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:45 user nova-compute[71325]: DEBUG nova.network.neutron [req-301fe951-fbff-4c18-b174-eb5c6356cee2 req-0d283891-41d1-45cc-8ba7-44ef826540d8 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Updated VIF entry in instance network info cache for port 596fdd61-68e0-4968-9d6a-e70d32a61ea1. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:52:45 user nova-compute[71325]: DEBUG nova.network.neutron [req-301fe951-fbff-4c18-b174-eb5c6356cee2 req-0d283891-41d1-45cc-8ba7-44ef826540d8 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Updating instance_info_cache with network_info: [{"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:45 user nova-compute[71325]: DEBUG nova.compute.manager [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Detach interface failed, port_id=2ade8fab-1fde-4730-aacc-fcb3b613c402, reason: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:52:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-301fe951-fbff-4c18-b174-eb5c6356cee2 req-0d283891-41d1-45cc-8ba7-44ef826540d8 service nova] Releasing lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:52:45 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:45 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Took 4.24 seconds to deallocate network for instance.
Apr 13 21:52:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Received event network-vif-deleted-f239b75b-16b7-4fcd-b3e3-d65f10278c43 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received event network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] Acquiring lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] No waiting events found dispatching network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:47 user nova-compute[71325]: WARNING nova.compute.manager [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received unexpected event network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance with vm_state building and task_state spawning.
Apr 13 21:52:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received event network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] Acquiring lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] No waiting events found dispatching network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:47 user nova-compute[71325]: WARNING nova.compute.manager [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received unexpected event network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance with vm_state building and task_state spawning.
Apr 13 21:52:47 user nova-compute[71325]: INFO nova.compute.manager [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Took 2.55 seconds to detach 3 volumes for instance.
Apr 13 21:52:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:47 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422752.8116612, af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:52:47 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] VM Stopped (Lifecycle Event)
Apr 13 21:52:47 user nova-compute[71325]: DEBUG nova.compute.manager [None req-ec085c24-adbb-4b9c-b94e-5759f36a2496 None None] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:52:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:48 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Deleted allocations for instance f16c661a-6f38-43fe-a801-a69de6e687ea
Apr 13 21:52:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "f16c661a-6f38-43fe-a801-a69de6e687ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.132s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422768.539557, 2d1990a1-40ec-4c02-941f-813c22e8cd8f => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:52:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] VM Resumed (Lifecycle Event)
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:52:48 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Instance spawned successfully.
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:52:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422768.5408044, 2d1990a1-40ec-4c02-941f-813c22e8cd8f => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:52:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] VM Started (Lifecycle Event)
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:52:48 user nova-compute[71325]: INFO nova.compute.manager [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Took 6.67 seconds to spawn the instance on the hypervisor.
Apr 13 21:52:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:52:48 user nova-compute[71325]: INFO nova.compute.manager [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Took 7.54 seconds to build instance.
Apr 13 21:52:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.642s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.objects.instance [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'flavor' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquired lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.network.neutron [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.objects.instance [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'info_cache' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.network.neutron [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Updating instance_info_cache with network_info: [{"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Releasing lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:52:49 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Instance destroyed successfully.
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.objects.instance [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'resources' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-140399517',display_name='tempest-AttachVolumeTestJSON-server-140399517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-140399517',id=3,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtoB3nR0JKHa6Ky1vXPwyI7w+rB3Ypa07sW6QVuaj3CXiFeuqRSmd55pQSr/lvFo9l5efcEiAn2oFJFeJlQXi0+ollyvkUFol9Z6nrTwTO2rVl/RiddJVHfv6WKf61UrQ==',key_name='tempest-keypair-789187285',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3605d609b52b431993bcea0798a77554',ramdisk_id='',reservation_id='r-gimed3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-249879422',owner_user_name='tempest-AttachVolumeTestJSON-249879422-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:50:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60e4dadf9d9e41e6a91ee03a0cd50dc3',uuid=ddc7aa71-95a1-4a3c-a5c1-746b86a011c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converting VIF {"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG os_vif [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa70898ac-83, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:49 user nova-compute[71325]: INFO os_vif [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83')
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Start _get_guest_xml network_info=[{"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.objects.instance [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'numa_topology' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:49 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:52:49 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:52:49 user nova-compute[71325]: DEBUG nova.objects.instance [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'vcpu_model' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-140399517',display_name='tempest-AttachVolumeTestJSON-server-140399517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-140399517',id=3,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtoB3nR0JKHa6Ky1vXPwyI7w+rB3Ypa07sW6QVuaj3CXiFeuqRSmd55pQSr/lvFo9l5efcEiAn2oFJFeJlQXi0+ollyvkUFol9Z6nrTwTO2rVl/RiddJVHfv6WKf61UrQ==',key_name='tempest-keypair-789187285',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3605d609b52b431993bcea0798a77554',ramdisk_id='',reservation_id='r-gimed3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-249879422',owner_user_name='tempest-AttachVolumeTestJSON-249879422-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:50:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60e4dadf9d9e41e6a91ee03a0cd50dc3',uuid=ddc7aa71-95a1-4a3c-a5c1-746b86a011c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converting VIF {"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG nova.objects.instance [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'pci_devices' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:52:50 user nova-compute[71325]:   <uuid>ddc7aa71-95a1-4a3c-a5c1-746b86a011c2</uuid>
Apr 13 21:52:50 user nova-compute[71325]:   <name>instance-00000003</name>
Apr 13 21:52:50 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:52:50 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:52:50 user nova-compute[71325]:   <metadata>
Apr 13 21:52:50 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:52:50 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:52:50 user nova-compute[71325]:       <nova:name>tempest-AttachVolumeTestJSON-server-140399517</nova:name>
Apr 13 21:52:50 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:52:49</nova:creationTime>
Apr 13 21:52:50 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:52:50 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:52:50 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:52:50 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:52:50 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:52:50 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:52:50 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:52:50 user nova-compute[71325]:       <nova:owner>
Apr 13 21:52:50 user nova-compute[71325]:         <nova:user uuid="60e4dadf9d9e41e6a91ee03a0cd50dc3">tempest-AttachVolumeTestJSON-249879422-project-member</nova:user>
Apr 13 21:52:50 user nova-compute[71325]:         <nova:project uuid="3605d609b52b431993bcea0798a77554">tempest-AttachVolumeTestJSON-249879422</nova:project>
Apr 13 21:52:50 user nova-compute[71325]:       </nova:owner>
Apr 13 21:52:50 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:52:50 user nova-compute[71325]:       <nova:ports>
Apr 13 21:52:50 user nova-compute[71325]:         <nova:port uuid="a70898ac-83fd-4f25-be37-aef7c87f6059">
Apr 13 21:52:50 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 21:52:50 user nova-compute[71325]:         </nova:port>
Apr 13 21:52:50 user nova-compute[71325]:       </nova:ports>
Apr 13 21:52:50 user nova-compute[71325]:     </nova:instance>
Apr 13 21:52:50 user nova-compute[71325]:   </metadata>
Apr 13 21:52:50 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:52:50 user nova-compute[71325]:     <system>
Apr 13 21:52:50 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:52:50 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:52:50 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:52:50 user nova-compute[71325]:       <entry name="serial">ddc7aa71-95a1-4a3c-a5c1-746b86a011c2</entry>
Apr 13 21:52:50 user nova-compute[71325]:       <entry name="uuid">ddc7aa71-95a1-4a3c-a5c1-746b86a011c2</entry>
Apr 13 21:52:50 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:52:50 user nova-compute[71325]:     </system>
Apr 13 21:52:50 user nova-compute[71325]:   </sysinfo>
Apr 13 21:52:50 user nova-compute[71325]:   <os>
Apr 13 21:52:50 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:52:50 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:52:50 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:52:50 user nova-compute[71325]:   </os>
Apr 13 21:52:50 user nova-compute[71325]:   <features>
Apr 13 21:52:50 user nova-compute[71325]:     <acpi/>
Apr 13 21:52:50 user nova-compute[71325]:     <apic/>
Apr 13 21:52:50 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:52:50 user nova-compute[71325]:   </features>
Apr 13 21:52:50 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:52:50 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:52:50 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:52:50 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:52:50 user nova-compute[71325]:   </clock>
Apr 13 21:52:50 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:52:50 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:52:50 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:52:50 user nova-compute[71325]:   </cpu>
Apr 13 21:52:50 user nova-compute[71325]:   <devices>
Apr 13 21:52:50 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:52:50 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:52:50 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk"/>
Apr 13 21:52:50 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:52:50 user nova-compute[71325]:     </disk>
Apr 13 21:52:50 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:52:50 user nova-compute[71325]:       <mac address="fa:16:3e:fd:52:e7"/>
Apr 13 21:52:50 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:52:50 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:52:50 user nova-compute[71325]:       <target dev="tapa70898ac-83"/>
Apr 13 21:52:50 user nova-compute[71325]:     </interface>
Apr 13 21:52:50 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:52:50 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/console.log" append="off"/>
Apr 13 21:52:50 user nova-compute[71325]:     </serial>
Apr 13 21:52:50 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:52:50 user nova-compute[71325]:     <video>
Apr 13 21:52:50 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:52:50 user nova-compute[71325]:     </video>
Apr 13 21:52:50 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:52:50 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:52:50 user nova-compute[71325]:     </rng>
Apr 13 21:52:50 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:52:50 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:52:50 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:52:50 user nova-compute[71325]:     </memballoon>
Apr 13 21:52:50 user nova-compute[71325]:   </devices>
Apr 13 21:52:50 user nova-compute[71325]: </domain>
Apr 13 21:52:50 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG nova.objects.instance [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'trusted_certs' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Cannot resize image /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG nova.objects.instance [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'migration_context' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-140399517',display_name='tempest-AttachVolumeTestJSON-server-140399517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-140399517',id=3,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtoB3nR0JKHa6Ky1vXPwyI7w+rB3Ypa07sW6QVuaj3CXiFeuqRSmd55pQSr/lvFo9l5efcEiAn2oFJFeJlQXi0+ollyvkUFol9Z6nrTwTO2rVl/RiddJVHfv6WKf61UrQ==',key_name='tempest-keypair-789187285',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3605d609b52b431993bcea0798a77554',ramdisk_id='',reservation_id='r-gimed3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-249879422',owner_user_name='tempest-AttachVolumeTestJSON-249879422-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:50:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60e4dadf9d9e41e6a91ee03a0cd50dc3',uuid=ddc7aa71-95a1-4a3c-a5c1-746b86a011c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converting VIF {"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG os_vif [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa70898ac-83, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa70898ac-83, col_values=(('external_ids', {'iface-id': 'a70898ac-83fd-4f25-be37-aef7c87f6059', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:52:e7', 'vm-uuid': 'ddc7aa71-95a1-4a3c-a5c1-746b86a011c2'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:52:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:50 user nova-compute[71325]: INFO os_vif [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83')
Apr 13 21:52:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-1be67399-edaf-4d01-9325-5ae57a378570 req-13f66cb2-6dbd-4ea3-9d47-31f71f18df9a service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1be67399-edaf-4d01-9325-5ae57a378570 req-13f66cb2-6dbd-4ea3-9d47-31f71f18df9a service nova] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1be67399-edaf-4d01-9325-5ae57a378570 req-13f66cb2-6dbd-4ea3-9d47-31f71f18df9a service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1be67399-edaf-4d01-9325-5ae57a378570 req-13f66cb2-6dbd-4ea3-9d47-31f71f18df9a service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-1be67399-edaf-4d01-9325-5ae57a378570 req-13f66cb2-6dbd-4ea3-9d47-31f71f18df9a service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] No waiting events found dispatching network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:52 user nova-compute[71325]: WARNING nova.compute.manager [req-1be67399-edaf-4d01-9325-5ae57a378570 req-13f66cb2-6dbd-4ea3-9d47-31f71f18df9a service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received unexpected event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 for instance with vm_state stopped and task_state powering-on.
Apr 13 21:52:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:54 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422759.1016905, f16c661a-6f38-43fe-a801-a69de6e687ea => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:52:54 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] VM Stopped (Lifecycle Event)
Apr 13 21:52:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a6a3bff5-0f5a-4b18-ac68-405ad8ec7511 None None] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:54 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422774.3936033, ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:52:54 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] VM Resumed (Lifecycle Event)
Apr 13 21:52:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:52:54 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Instance rebooted successfully.
Apr 13 21:52:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:52:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-5b2d8ea8-2ca6-46c9-b134-337571398386 req-ae0b80d3-59b3-4487-bb9f-dbba6f244c4e service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:52:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5b2d8ea8-2ca6-46c9-b134-337571398386 req-ae0b80d3-59b3-4487-bb9f-dbba6f244c4e service nova] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:52:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5b2d8ea8-2ca6-46c9-b134-337571398386 req-ae0b80d3-59b3-4487-bb9f-dbba6f244c4e service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:52:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5b2d8ea8-2ca6-46c9-b134-337571398386 req-ae0b80d3-59b3-4487-bb9f-dbba6f244c4e service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:52:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-5b2d8ea8-2ca6-46c9-b134-337571398386 req-ae0b80d3-59b3-4487-bb9f-dbba6f244c4e service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] No waiting events found dispatching network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:52:54 user nova-compute[71325]: WARNING nova.compute.manager [req-5b2d8ea8-2ca6-46c9-b134-337571398386 req-ae0b80d3-59b3-4487-bb9f-dbba6f244c4e service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received unexpected event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 for instance with vm_state stopped and task_state powering-on.
Apr 13 21:52:54 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 13 21:52:54 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422774.3948913, ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:52:54 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] VM Started (Lifecycle Event)
Apr 13 21:52:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:52:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:52:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:52:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:04 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:53:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:05 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:53:05 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:53:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:06 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:53:06 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:53:06 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 21:53:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:53:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:53:06 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:53:06 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lazy-loading 'info_cache' on Instance uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Updating instance_info_cache with network_info: [{"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:53:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:10 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:53:10 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:53:10 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7652MB free_disk=26.287006378173828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 03554793-01dd-4629-97c7-b640f5934639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:53:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:11 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:53:11 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:53:11 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:53:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:14 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:53:14 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:53:14 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:53:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:53:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:53:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:39 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:53:39 user nova-compute[71325]: INFO nova.compute.claims [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Claim successful on node user
Apr 13 21:53:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:39 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:53:39 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:53:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG nova.compute.manager [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG nova.network.neutron [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:53:40 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:53:40 user nova-compute[71325]: DEBUG nova.compute.manager [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG nova.policy [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG nova.compute.manager [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:53:40 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Creating image(s)
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "/opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "/opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "/opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.191s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk 1073741824" returned: 0 in 0.071s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.177s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Cannot resize image /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'migration_context' on Instance uuid 78b584a2-7dbc-4793-9d93-37897f9a24b1 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Ensure instance console log exists: /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:41 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:53:41 user nova-compute[71325]: DEBUG nova.network.neutron [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Successfully created port: 1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:53:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:41 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:53:41 user nova-compute[71325]: INFO nova.compute.claims [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Claim successful on node user
Apr 13 21:53:41 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:53:41 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:53:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:41 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:53:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.policy [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.network.neutron [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Successfully updated port: 1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "refresh_cache-78b584a2-7dbc-4793-9d93-37897f9a24b1" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquired lock "refresh_cache-78b584a2-7dbc-4793-9d93-37897f9a24b1" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.network.neutron [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-ebb139ee-8403-4ef7-8f6f-2b12da8a0601 req-6cceef86-9e84-4e47-bd3e-dd59ee2d3bac service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Received event network-changed-1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-ebb139ee-8403-4ef7-8f6f-2b12da8a0601 req-6cceef86-9e84-4e47-bd3e-dd59ee2d3bac service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Refreshing instance network info cache due to event network-changed-1d9d691f-bf56-4916-9d1d-422be2299247. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ebb139ee-8403-4ef7-8f6f-2b12da8a0601 req-6cceef86-9e84-4e47-bd3e-dd59ee2d3bac service nova] Acquiring lock "refresh_cache-78b584a2-7dbc-4793-9d93-37897f9a24b1" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:53:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Creating image(s)
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "/opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "/opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "/opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.network.neutron [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk 1073741824" returned: 0 in 0.066s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.network.neutron [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Updating instance_info_cache with network_info: [{"id": "1d9d691f-bf56-4916-9d1d-422be2299247", "address": "fa:16:3e:54:e6:ae", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d9d691f-bf", "ovs_interfaceid": "1d9d691f-bf56-4916-9d1d-422be2299247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Releasing lock "refresh_cache-78b584a2-7dbc-4793-9d93-37897f9a24b1" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Instance network_info: |[{"id": "1d9d691f-bf56-4916-9d1d-422be2299247", "address": "fa:16:3e:54:e6:ae", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d9d691f-bf", "ovs_interfaceid": "1d9d691f-bf56-4916-9d1d-422be2299247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ebb139ee-8403-4ef7-8f6f-2b12da8a0601 req-6cceef86-9e84-4e47-bd3e-dd59ee2d3bac service nova] Acquired lock "refresh_cache-78b584a2-7dbc-4793-9d93-37897f9a24b1" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.network.neutron [req-ebb139ee-8403-4ef7-8f6f-2b12da8a0601 req-6cceef86-9e84-4e47-bd3e-dd59ee2d3bac service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Refreshing network info cache for port 1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Start _get_guest_xml network_info=[{"id": "1d9d691f-bf56-4916-9d1d-422be2299247", "address": "fa:16:3e:54:e6:ae", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d9d691f-bf", "ovs_interfaceid": "1d9d691f-bf56-4916-9d1d-422be2299247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:53:42 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:53:42 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1694878634',display_name='tempest-AttachVolumeNegativeTest-server-1694878634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1694878634',id=22,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKJiqdp3UBkP4HWGZ5pWWYRJwdY0AOytmb2C1U8rxnqJI+4BzVnFyxZoE6lJ7BrL1WIxSTz0CI4SBaf/l6Xft8tRo7bYgdhhDCuyQIZN1/utqRkjzxMGWh3aakpxsff6Q==',key_name='tempest-keypair-130014745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446b51db737947ab9bddd5fc47488bc7',ramdisk_id='',reservation_id='r-my0gt2j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-920375840',owner_user_name='tempest-AttachVolumeNegativeTest-920375840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:53:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145c0a177fcc4b94b5480d8806554ac9',uuid=78b584a2-7dbc-4793-9d93-37897f9a24b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d9d691f-bf56-4916-9d1d-422be2299247", "address": "fa:16:3e:54:e6:ae", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d9d691f-bf", "ovs_interfaceid": "1d9d691f-bf56-4916-9d1d-422be2299247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converting VIF {"id": "1d9d691f-bf56-4916-9d1d-422be2299247", "address": "fa:16:3e:54:e6:ae", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d9d691f-bf", "ovs_interfaceid": "1d9d691f-bf56-4916-9d1d-422be2299247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:e6:ae,bridge_name='br-int',has_traffic_filtering=True,id=1d9d691f-bf56-4916-9d1d-422be2299247,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d9d691f-bf') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'pci_devices' on Instance uuid 78b584a2-7dbc-4793-9d93-37897f9a24b1 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Cannot resize image /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.objects.instance [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'migration_context' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:53:42 user nova-compute[71325]:   <uuid>78b584a2-7dbc-4793-9d93-37897f9a24b1</uuid>
Apr 13 21:53:42 user nova-compute[71325]:   <name>instance-00000016</name>
Apr 13 21:53:42 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:53:42 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:53:42 user nova-compute[71325]:   <metadata>
Apr 13 21:53:42 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:53:42 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:53:42 user nova-compute[71325]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1694878634</nova:name>
Apr 13 21:53:42 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:53:42</nova:creationTime>
Apr 13 21:53:42 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:53:42 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:53:42 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:53:42 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:53:42 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:53:42 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:53:42 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:53:42 user nova-compute[71325]:       <nova:owner>
Apr 13 21:53:42 user nova-compute[71325]:         <nova:user uuid="145c0a177fcc4b94b5480d8806554ac9">tempest-AttachVolumeNegativeTest-920375840-project-member</nova:user>
Apr 13 21:53:42 user nova-compute[71325]:         <nova:project uuid="446b51db737947ab9bddd5fc47488bc7">tempest-AttachVolumeNegativeTest-920375840</nova:project>
Apr 13 21:53:42 user nova-compute[71325]:       </nova:owner>
Apr 13 21:53:42 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:53:42 user nova-compute[71325]:       <nova:ports>
Apr 13 21:53:42 user nova-compute[71325]:         <nova:port uuid="1d9d691f-bf56-4916-9d1d-422be2299247">
Apr 13 21:53:42 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 21:53:42 user nova-compute[71325]:         </nova:port>
Apr 13 21:53:42 user nova-compute[71325]:       </nova:ports>
Apr 13 21:53:42 user nova-compute[71325]:     </nova:instance>
Apr 13 21:53:42 user nova-compute[71325]:   </metadata>
Apr 13 21:53:42 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:53:42 user nova-compute[71325]:     <system>
Apr 13 21:53:42 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:53:42 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:53:42 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:53:42 user nova-compute[71325]:       <entry name="serial">78b584a2-7dbc-4793-9d93-37897f9a24b1</entry>
Apr 13 21:53:42 user nova-compute[71325]:       <entry name="uuid">78b584a2-7dbc-4793-9d93-37897f9a24b1</entry>
Apr 13 21:53:42 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:53:42 user nova-compute[71325]:     </system>
Apr 13 21:53:42 user nova-compute[71325]:   </sysinfo>
Apr 13 21:53:42 user nova-compute[71325]:   <os>
Apr 13 21:53:42 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:53:42 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:53:42 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:53:42 user nova-compute[71325]:   </os>
Apr 13 21:53:42 user nova-compute[71325]:   <features>
Apr 13 21:53:42 user nova-compute[71325]:     <acpi/>
Apr 13 21:53:42 user nova-compute[71325]:     <apic/>
Apr 13 21:53:42 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:53:42 user nova-compute[71325]:   </features>
Apr 13 21:53:42 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:53:42 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:53:42 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:53:42 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:53:42 user nova-compute[71325]:   </clock>
Apr 13 21:53:42 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:53:42 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:53:42 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:53:42 user nova-compute[71325]:   </cpu>
Apr 13 21:53:42 user nova-compute[71325]:   <devices>
Apr 13 21:53:42 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:53:42 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:53:42 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk"/>
Apr 13 21:53:42 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:53:42 user nova-compute[71325]:     </disk>
Apr 13 21:53:42 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:53:42 user nova-compute[71325]:       <mac address="fa:16:3e:54:e6:ae"/>
Apr 13 21:53:42 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:53:42 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:53:42 user nova-compute[71325]:       <target dev="tap1d9d691f-bf"/>
Apr 13 21:53:42 user nova-compute[71325]:     </interface>
Apr 13 21:53:42 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:53:42 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/console.log" append="off"/>
Apr 13 21:53:42 user nova-compute[71325]:     </serial>
Apr 13 21:53:42 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:53:42 user nova-compute[71325]:     <video>
Apr 13 21:53:42 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:53:42 user nova-compute[71325]:     </video>
Apr 13 21:53:42 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:53:42 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:53:42 user nova-compute[71325]:     </rng>
Apr 13 21:53:42 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:53:42 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:53:42 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:53:42 user nova-compute[71325]:     </memballoon>
Apr 13 21:53:42 user nova-compute[71325]:   </devices>
Apr 13 21:53:42 user nova-compute[71325]: </domain>
Apr 13 21:53:42 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1694878634',display_name='tempest-AttachVolumeNegativeTest-server-1694878634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1694878634',id=22,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKJiqdp3UBkP4HWGZ5pWWYRJwdY0AOytmb2C1U8rxnqJI+4BzVnFyxZoE6lJ7BrL1WIxSTz0CI4SBaf/l6Xft8tRo7bYgdhhDCuyQIZN1/utqRkjzxMGWh3aakpxsff6Q==',key_name='tempest-keypair-130014745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446b51db737947ab9bddd5fc47488bc7',ramdisk_id='',reservation_id='r-my0gt2j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-920375840',owner_user_name='tempest-AttachVolumeNegativeTest-920375840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:53:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145c0a177fcc4b94b5480d8806554ac9',uuid=78b584a2-7dbc-4793-9d93-37897f9a24b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d9d691f-bf56-4916-9d1d-422be2299247", "address": "fa:16:3e:54:e6:ae", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d9d691f-bf", "ovs_interfaceid": "1d9d691f-bf56-4916-9d1d-422be2299247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converting VIF {"id": "1d9d691f-bf56-4916-9d1d-422be2299247", "address": "fa:16:3e:54:e6:ae", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d9d691f-bf", "ovs_interfaceid": "1d9d691f-bf56-4916-9d1d-422be2299247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:e6:ae,bridge_name='br-int',has_traffic_filtering=True,id=1d9d691f-bf56-4916-9d1d-422be2299247,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d9d691f-bf') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG os_vif [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:e6:ae,bridge_name='br-int',has_traffic_filtering=True,id=1d9d691f-bf56-4916-9d1d-422be2299247,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d9d691f-bf') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Ensure instance console log exists: /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d9d691f-bf, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d9d691f-bf, col_values=(('external_ids', {'iface-id': '1d9d691f-bf56-4916-9d1d-422be2299247', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:e6:ae', 'vm-uuid': '78b584a2-7dbc-4793-9d93-37897f9a24b1'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:42 user nova-compute[71325]: INFO os_vif [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:e6:ae,bridge_name='br-int',has_traffic_filtering=True,id=1d9d691f-bf56-4916-9d1d-422be2299247,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d9d691f-bf')
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:53:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No VIF found with MAC fa:16:3e:54:e6:ae, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:53:43 user nova-compute[71325]: DEBUG nova.network.neutron [req-ebb139ee-8403-4ef7-8f6f-2b12da8a0601 req-6cceef86-9e84-4e47-bd3e-dd59ee2d3bac service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Updated VIF entry in instance network info cache for port 1d9d691f-bf56-4916-9d1d-422be2299247. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:53:43 user nova-compute[71325]: DEBUG nova.network.neutron [req-ebb139ee-8403-4ef7-8f6f-2b12da8a0601 req-6cceef86-9e84-4e47-bd3e-dd59ee2d3bac service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Updating instance_info_cache with network_info: [{"id": "1d9d691f-bf56-4916-9d1d-422be2299247", "address": "fa:16:3e:54:e6:ae", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d9d691f-bf", "ovs_interfaceid": "1d9d691f-bf56-4916-9d1d-422be2299247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:53:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ebb139ee-8403-4ef7-8f6f-2b12da8a0601 req-6cceef86-9e84-4e47-bd3e-dd59ee2d3bac service nova] Releasing lock "refresh_cache-78b584a2-7dbc-4793-9d93-37897f9a24b1" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:53:43 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Successfully created port: a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:53:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-7b7c9d98-289f-4be6-a92b-9dbcd27d65c3 req-ad9dde90-064f-4c6e-9290-4d2b368e091b service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Received event network-vif-plugged-1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:53:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7b7c9d98-289f-4be6-a92b-9dbcd27d65c3 req-ad9dde90-064f-4c6e-9290-4d2b368e091b service nova] Acquiring lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7b7c9d98-289f-4be6-a92b-9dbcd27d65c3 req-ad9dde90-064f-4c6e-9290-4d2b368e091b service nova] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7b7c9d98-289f-4be6-a92b-9dbcd27d65c3 req-ad9dde90-064f-4c6e-9290-4d2b368e091b service nova] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-7b7c9d98-289f-4be6-a92b-9dbcd27d65c3 req-ad9dde90-064f-4c6e-9290-4d2b368e091b service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] No waiting events found dispatching network-vif-plugged-1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:53:44 user nova-compute[71325]: WARNING nova.compute.manager [req-7b7c9d98-289f-4be6-a92b-9dbcd27d65c3 req-ad9dde90-064f-4c6e-9290-4d2b368e091b service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Received unexpected event network-vif-plugged-1d9d691f-bf56-4916-9d1d-422be2299247 for instance with vm_state building and task_state spawning.
Apr 13 21:53:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:45 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Successfully updated port: a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:53:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:53:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquired lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:53:45 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:53:45 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Updating instance_info_cache with network_info: [{"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Releasing lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Instance network_info: |[{"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Start _get_guest_xml network_info=[{"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:53:46 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:53:46 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-83885280',display_name='tempest-ServerRescueNegativeTestJSON-server-83885280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-83885280',id=23,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEkikMBfKYBaVz9RAPAAHtgluCulNhaXlNnXRmd1wytRaQFaosDdHshmuQB0as4KbHDZo1Ux4sl5RXfhe13p5VrH2Y8uYO2igQjKNR7Nb3FHusXdWK16NLMOw2+fvY10Q==',key_name='tempest-keypair-1299306137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70e84a09a76a44eb830e575db4321224',ramdisk_id='',reservation_id='r-3v2jgje0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-546430736',owner_user_name='tempest-ServerRescueNegativeTestJSON-546430736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:53:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e77459bc3fa8496da1a089c460e32ed2',uuid=b87dfe1b-f651-436d-87b5-eb257ef1a6e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converting VIF {"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:ad:c6,bridge_name='br-int',has_traffic_filtering=True,id=a438af72-b7ff-4ab6-82f5-59cf460c430f,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa438af72-b7') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.objects.instance [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'pci_devices' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:53:46 user nova-compute[71325]:   <uuid>b87dfe1b-f651-436d-87b5-eb257ef1a6e8</uuid>
Apr 13 21:53:46 user nova-compute[71325]:   <name>instance-00000017</name>
Apr 13 21:53:46 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:53:46 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:53:46 user nova-compute[71325]:   <metadata>
Apr 13 21:53:46 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:53:46 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:53:46 user nova-compute[71325]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-83885280</nova:name>
Apr 13 21:53:46 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:53:46</nova:creationTime>
Apr 13 21:53:46 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:53:46 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:53:46 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:53:46 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:53:46 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:53:46 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:53:46 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:53:46 user nova-compute[71325]:       <nova:owner>
Apr 13 21:53:46 user nova-compute[71325]:         <nova:user uuid="e77459bc3fa8496da1a089c460e32ed2">tempest-ServerRescueNegativeTestJSON-546430736-project-member</nova:user>
Apr 13 21:53:46 user nova-compute[71325]:         <nova:project uuid="70e84a09a76a44eb830e575db4321224">tempest-ServerRescueNegativeTestJSON-546430736</nova:project>
Apr 13 21:53:46 user nova-compute[71325]:       </nova:owner>
Apr 13 21:53:46 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:53:46 user nova-compute[71325]:       <nova:ports>
Apr 13 21:53:46 user nova-compute[71325]:         <nova:port uuid="a438af72-b7ff-4ab6-82f5-59cf460c430f">
Apr 13 21:53:46 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 21:53:46 user nova-compute[71325]:         </nova:port>
Apr 13 21:53:46 user nova-compute[71325]:       </nova:ports>
Apr 13 21:53:46 user nova-compute[71325]:     </nova:instance>
Apr 13 21:53:46 user nova-compute[71325]:   </metadata>
Apr 13 21:53:46 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:53:46 user nova-compute[71325]:     <system>
Apr 13 21:53:46 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:53:46 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:53:46 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:53:46 user nova-compute[71325]:       <entry name="serial">b87dfe1b-f651-436d-87b5-eb257ef1a6e8</entry>
Apr 13 21:53:46 user nova-compute[71325]:       <entry name="uuid">b87dfe1b-f651-436d-87b5-eb257ef1a6e8</entry>
Apr 13 21:53:46 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:53:46 user nova-compute[71325]:     </system>
Apr 13 21:53:46 user nova-compute[71325]:   </sysinfo>
Apr 13 21:53:46 user nova-compute[71325]:   <os>
Apr 13 21:53:46 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:53:46 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:53:46 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:53:46 user nova-compute[71325]:   </os>
Apr 13 21:53:46 user nova-compute[71325]:   <features>
Apr 13 21:53:46 user nova-compute[71325]:     <acpi/>
Apr 13 21:53:46 user nova-compute[71325]:     <apic/>
Apr 13 21:53:46 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:53:46 user nova-compute[71325]:   </features>
Apr 13 21:53:46 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:53:46 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:53:46 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:53:46 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:53:46 user nova-compute[71325]:   </clock>
Apr 13 21:53:46 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:53:46 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:53:46 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:53:46 user nova-compute[71325]:   </cpu>
Apr 13 21:53:46 user nova-compute[71325]:   <devices>
Apr 13 21:53:46 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:53:46 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:53:46 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk"/>
Apr 13 21:53:46 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:53:46 user nova-compute[71325]:     </disk>
Apr 13 21:53:46 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:53:46 user nova-compute[71325]:       <mac address="fa:16:3e:79:ad:c6"/>
Apr 13 21:53:46 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:53:46 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:53:46 user nova-compute[71325]:       <target dev="tapa438af72-b7"/>
Apr 13 21:53:46 user nova-compute[71325]:     </interface>
Apr 13 21:53:46 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:53:46 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/console.log" append="off"/>
Apr 13 21:53:46 user nova-compute[71325]:     </serial>
Apr 13 21:53:46 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:53:46 user nova-compute[71325]:     <video>
Apr 13 21:53:46 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:53:46 user nova-compute[71325]:     </video>
Apr 13 21:53:46 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:53:46 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:53:46 user nova-compute[71325]:     </rng>
Apr 13 21:53:46 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:53:46 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:53:46 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:53:46 user nova-compute[71325]:     </memballoon>
Apr 13 21:53:46 user nova-compute[71325]:   </devices>
Apr 13 21:53:46 user nova-compute[71325]: </domain>
Apr 13 21:53:46 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-83885280',display_name='tempest-ServerRescueNegativeTestJSON-server-83885280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-83885280',id=23,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEkikMBfKYBaVz9RAPAAHtgluCulNhaXlNnXRmd1wytRaQFaosDdHshmuQB0as4KbHDZo1Ux4sl5RXfhe13p5VrH2Y8uYO2igQjKNR7Nb3FHusXdWK16NLMOw2+fvY10Q==',key_name='tempest-keypair-1299306137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70e84a09a76a44eb830e575db4321224',ramdisk_id='',reservation_id='r-3v2jgje0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-546430736',owner_user_name='tempest-ServerRescueNegativeTestJSON-546430736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:53:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e77459bc3fa8496da1a089c460e32ed2',uuid=b87dfe1b-f651-436d-87b5-eb257ef1a6e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converting VIF {"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:ad:c6,bridge_name='br-int',has_traffic_filtering=True,id=a438af72-b7ff-4ab6-82f5-59cf460c430f,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa438af72-b7') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG os_vif [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:ad:c6,bridge_name='br-int',has_traffic_filtering=True,id=a438af72-b7ff-4ab6-82f5-59cf460c430f,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa438af72-b7') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa438af72-b7, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa438af72-b7, col_values=(('external_ids', {'iface-id': 'a438af72-b7ff-4ab6-82f5-59cf460c430f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:ad:c6', 'vm-uuid': 'b87dfe1b-f651-436d-87b5-eb257ef1a6e8'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:46 user nova-compute[71325]: INFO os_vif [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:ad:c6,bridge_name='br-int',has_traffic_filtering=True,id=a438af72-b7ff-4ab6-82f5-59cf460c430f,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa438af72-b7')
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No VIF found with MAC fa:16:3e:79:ad:c6, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422826.6059873, 78b584a2-7dbc-4793-9d93-37897f9a24b1 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:53:46 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] VM Resumed (Lifecycle Event)
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.compute.manager [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:53:46 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Instance spawned successfully.
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:53:46 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422826.6129117, 78b584a2-7dbc-4793-9d93-37897f9a24b1 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:53:46 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] VM Started (Lifecycle Event)
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:53:46 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:53:46 user nova-compute[71325]: INFO nova.compute.manager [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Took 6.57 seconds to spawn the instance on the hypervisor.
Apr 13 21:53:46 user nova-compute[71325]: DEBUG nova.compute.manager [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:53:46 user nova-compute[71325]: INFO nova.compute.manager [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Took 7.40 seconds to build instance.
Apr 13 21:53:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.527s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Received event network-vif-plugged-1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:53:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] Acquiring lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] No waiting events found dispatching network-vif-plugged-1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:53:47 user nova-compute[71325]: WARNING nova.compute.manager [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Received unexpected event network-vif-plugged-1d9d691f-bf56-4916-9d1d-422be2299247 for instance with vm_state active and task_state None.
Apr 13 21:53:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-changed-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:53:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Refreshing instance network info cache due to event network-changed-a438af72-b7ff-4ab6-82f5-59cf460c430f. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:53:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] Acquiring lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:53:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] Acquired lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:53:47 user nova-compute[71325]: DEBUG nova.network.neutron [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Refreshing network info cache for port a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:53:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:48 user nova-compute[71325]: DEBUG nova.network.neutron [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Updated VIF entry in instance network info cache for port a438af72-b7ff-4ab6-82f5-59cf460c430f. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:53:48 user nova-compute[71325]: DEBUG nova.network.neutron [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Updating instance_info_cache with network_info: [{"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:53:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] Releasing lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:53:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:53:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] No waiting events found dispatching network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:53:49 user nova-compute[71325]: WARNING nova.compute.manager [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received unexpected event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f for instance with vm_state building and task_state spawning.
Apr 13 21:53:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:53:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] No waiting events found dispatching network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:53:49 user nova-compute[71325]: WARNING nova.compute.manager [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received unexpected event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f for instance with vm_state building and task_state spawning.
Apr 13 21:53:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:49 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422829.9742568, b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:53:49 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] VM Resumed (Lifecycle Event)
Apr 13 21:53:49 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:53:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:53:49 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Instance spawned successfully.
Apr 13 21:53:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:53:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:53:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:53:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:53:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:53:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:53:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:53:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:53:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:53:50 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:53:50 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422829.974748, b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:53:50 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] VM Started (Lifecycle Event)
Apr 13 21:53:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:53:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:53:50 user nova-compute[71325]: INFO nova.compute.manager [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Took 7.93 seconds to spawn the instance on the hypervisor.
Apr 13 21:53:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:53:50 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:53:50 user nova-compute[71325]: INFO nova.compute.manager [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Took 8.90 seconds to build instance.
Apr 13 21:53:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.074s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:51 user nova-compute[71325]: INFO nova.compute.manager [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Terminating instance
Apr 13 21:53:51 user nova-compute[71325]: DEBUG nova.compute.manager [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-42e203d9-17dd-41d3-87ec-858053c32967 req-2b1d7855-e3d1-4830-8ba8-a3015da3dbd3 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Received event network-vif-unplugged-ba4d973f-18b3-4b49-b663-627155851ce8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-42e203d9-17dd-41d3-87ec-858053c32967 req-2b1d7855-e3d1-4830-8ba8-a3015da3dbd3 service nova] Acquiring lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-42e203d9-17dd-41d3-87ec-858053c32967 req-2b1d7855-e3d1-4830-8ba8-a3015da3dbd3 service nova] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-42e203d9-17dd-41d3-87ec-858053c32967 req-2b1d7855-e3d1-4830-8ba8-a3015da3dbd3 service nova] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-42e203d9-17dd-41d3-87ec-858053c32967 req-2b1d7855-e3d1-4830-8ba8-a3015da3dbd3 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] No waiting events found dispatching network-vif-unplugged-ba4d973f-18b3-4b49-b663-627155851ce8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-42e203d9-17dd-41d3-87ec-858053c32967 req-2b1d7855-e3d1-4830-8ba8-a3015da3dbd3 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Received event network-vif-unplugged-ba4d973f-18b3-4b49-b663-627155851ce8 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:53:51 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Instance destroyed successfully.
Apr 13 21:53:51 user nova-compute[71325]: DEBUG nova.objects.instance [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lazy-loading 'resources' on Instance uuid 8645ede7-1e10-4520-8092-6cc6dfc3d82a {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2106730690',display_name='tempest-ServersNegativeTestJSON-server-2106730690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2106730690',id=2,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1071d640fb44ff9966fab7888668ed5',ramdisk_id='',reservation_id='r-7xnr3wkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1571285098',owner_user_name='tempest-ServersNegativeTestJSON-1571285098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:45:29Z,user_data=None,user_id='02a7fc7a42b441cfa3c6bc04f4dd6cb9',uuid=8645ede7-1e10-4520-8092-6cc6dfc3d82a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4d973f-18b3-4b49-b663-627155851ce8", "address": "fa:16:3e:36:cc:b4", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4d973f-18", "ovs_interfaceid": "ba4d973f-18b3-4b49-b663-627155851ce8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Converting VIF {"id": "ba4d973f-18b3-4b49-b663-627155851ce8", "address": "fa:16:3e:36:cc:b4", "network": {"id": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-699543057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1071d640fb44ff9966fab7888668ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4d973f-18", "ovs_interfaceid": "ba4d973f-18b3-4b49-b663-627155851ce8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:cc:b4,bridge_name='br-int',has_traffic_filtering=True,id=ba4d973f-18b3-4b49-b663-627155851ce8,network=Network(ed9169cc-af6d-4d31-9b2e-9016c5f963c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4d973f-18') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG os_vif [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:cc:b4,bridge_name='br-int',has_traffic_filtering=True,id=ba4d973f-18b3-4b49-b663-627155851ce8,network=Network(ed9169cc-af6d-4d31-9b2e-9016c5f963c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4d973f-18') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba4d973f-18, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:53:51 user nova-compute[71325]: INFO os_vif [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:cc:b4,bridge_name='br-int',has_traffic_filtering=True,id=ba4d973f-18b3-4b49-b663-627155851ce8,network=Network(ed9169cc-af6d-4d31-9b2e-9016c5f963c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4d973f-18')
Apr 13 21:53:51 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Deleting instance files /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a_del
Apr 13 21:53:51 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Deletion of /opt/stack/data/nova/instances/8645ede7-1e10-4520-8092-6cc6dfc3d82a_del complete
Apr 13 21:53:52 user nova-compute[71325]: INFO nova.compute.manager [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 13 21:53:52 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:53:52 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:53:52 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:53:52 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:53:52 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Took 0.60 seconds to deallocate network for instance.
Apr 13 21:53:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-b18ef3c3-12f4-4d50-98d8-563d1cc8be02 req-016ae29b-8735-48f5-8151-a8e41a4bc97e service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Received event network-vif-deleted-ba4d973f-18b3-4b49-b663-627155851ce8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:53:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:53 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:53:53 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:53:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:53 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Deleted allocations for instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a
Apr 13 21:53:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.335s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-05a58b6b-54fb-4631-9010-5739e492afad req-9640d1b3-19c7-43e5-ad4c-365754d98071 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Received event network-vif-plugged-ba4d973f-18b3-4b49-b663-627155851ce8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:53:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-05a58b6b-54fb-4631-9010-5739e492afad req-9640d1b3-19c7-43e5-ad4c-365754d98071 service nova] Acquiring lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-05a58b6b-54fb-4631-9010-5739e492afad req-9640d1b3-19c7-43e5-ad4c-365754d98071 service nova] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-05a58b6b-54fb-4631-9010-5739e492afad req-9640d1b3-19c7-43e5-ad4c-365754d98071 service nova] Lock "8645ede7-1e10-4520-8092-6cc6dfc3d82a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-05a58b6b-54fb-4631-9010-5739e492afad req-9640d1b3-19c7-43e5-ad4c-365754d98071 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] No waiting events found dispatching network-vif-plugged-ba4d973f-18b3-4b49-b663-627155851ce8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:53:53 user nova-compute[71325]: WARNING nova.compute.manager [req-05a58b6b-54fb-4631-9010-5739e492afad req-9640d1b3-19c7-43e5-ad4c-365754d98071 service nova] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Received unexpected event network-vif-plugged-ba4d973f-18b3-4b49-b663-627155851ce8 for instance with vm_state deleted and task_state None.
Apr 13 21:53:54 user nova-compute[71325]: INFO nova.compute.manager [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Rescuing
Apr 13 21:53:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:53:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquired lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:53:54 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:53:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:54 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Updating instance_info_cache with network_info: [{"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:53:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Releasing lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:53:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:55 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Instance destroyed successfully.
Apr 13 21:53:55 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Attempting a stable device rescue
Apr 13 21:53:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71325) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 21:53:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Instance directory exists: not creating {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 21:53:55 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Creating image(s)
Apr 13 21:53:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "/opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "/opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:55 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6fbf2022-b069-440f-8513-6d107f0a7180 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:53:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-66f04f38-aff9-4e52-b081-2f72e7de4d20 req-3a61f9bf-40f4-4b15-b5f1-98b18d57e40f service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-vif-unplugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:53:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-66f04f38-aff9-4e52-b081-2f72e7de4d20 req-3a61f9bf-40f4-4b15-b5f1-98b18d57e40f service nova] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-66f04f38-aff9-4e52-b081-2f72e7de4d20 req-3a61f9bf-40f4-4b15-b5f1-98b18d57e40f service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-66f04f38-aff9-4e52-b081-2f72e7de4d20 req-3a61f9bf-40f4-4b15-b5f1-98b18d57e40f service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-66f04f38-aff9-4e52-b081-2f72e7de4d20 req-3a61f9bf-40f4-4b15-b5f1-98b18d57e40f service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] No waiting events found dispatching network-vif-unplugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:53:55 user nova-compute[71325]: WARNING nova.compute.manager [req-66f04f38-aff9-4e52-b081-2f72e7de4d20 req-3a61f9bf-40f4-4b15-b5f1-98b18d57e40f service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received unexpected event network-vif-unplugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance with vm_state active and task_state rescuing.
Apr 13 21:53:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "d44cb95d946196042d39ea4c585e9c43909efb3f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "d44cb95d946196042d39ea4c585e9c43909efb3f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f.part --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f.part --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:56 user nova-compute[71325]: DEBUG nova.virt.images [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 89ddd8a5-995e-42f7-8315-c0834fd3d45a was qcow2, converting to raw {{(pid=71325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 21:53:56 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:53:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f.part /opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f.converted {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f.part /opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f.converted" returned: 0 in 0.459s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f.converted --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "d44cb95d946196042d39ea4c585e9c43909efb3f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.740s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "d44cb95d946196042d39ea4c585e9c43909efb3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "d44cb95d946196042d39ea4c585e9c43909efb3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f --force-share --output=json" returned: 0 in 0.167s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f,backing_fmt=raw /opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/disk.rescue {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f,backing_fmt=raw /opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/disk.rescue" returned: 0 in 0.056s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "d44cb95d946196042d39ea4c585e9c43909efb3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'migration_context' on Instance uuid 6fbf2022-b069-440f-8513-6d107f0a7180 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Start _get_guest_xml network_info=[{"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "vif_mac": "fa:16:3e:2f:96:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '89ddd8a5-995e-42f7-8315-c0834fd3d45a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVSNAbZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '6fbf2022-b069-440f-8513-6d107f0a7180', 'attached_at': '', 'detached_at': '', 'volume_id': '2e3f9d31-e4a2-4e3d-9823-819f1c1244ce', 'serial': '2e3f9d31-e4a2-4e3d-9823-819f1c1244ce'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '64c44592-ffba-456d-8ee8-bb583b9c6fbc', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'resources' on Instance uuid 6fbf2022-b069-440f-8513-6d107f0a7180 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'numa_topology' on Instance uuid 6fbf2022-b069-440f-8513-6d107f0a7180 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.compute.manager [req-91b1ee35-5147-4179-ad23-0659560462e1 req-51bae466-f5bc-45e1-9c13-0d91e647da48 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-91b1ee35-5147-4179-ad23-0659560462e1 req-51bae466-f5bc-45e1-9c13-0d91e647da48 service nova] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-91b1ee35-5147-4179-ad23-0659560462e1 req-51bae466-f5bc-45e1-9c13-0d91e647da48 service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-91b1ee35-5147-4179-ad23-0659560462e1 req-51bae466-f5bc-45e1-9c13-0d91e647da48 service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.compute.manager [req-91b1ee35-5147-4179-ad23-0659560462e1 req-51bae466-f5bc-45e1-9c13-0d91e647da48 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] No waiting events found dispatching network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:53:57 user nova-compute[71325]: WARNING nova.compute.manager [req-91b1ee35-5147-4179-ad23-0659560462e1 req-51bae466-f5bc-45e1-9c13-0d91e647da48 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received unexpected event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance with vm_state active and task_state rescuing.
Apr 13 21:53:57 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:53:57 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:53:57 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6fbf2022-b069-440f-8513-6d107f0a7180 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVSNAbZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:53:58 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:53:58 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:53:58 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd53621-1f24-45d1-90ac-b8a4681f4734]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gVSNAbZE\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 21:53:58 user nova-compute[71325]: node.name = iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:53:58 user nova-compute[71325]: node.tpgt = -1
Apr 13 21:53:58 user nova-compute[71325]: node.startup = automatic
Apr 13 21:53:58 user nova-compute[71325]: node.leading_login = No
Apr 13 21:53:58 user nova-compute[71325]: iface.iscsi_ifacename = default
Apr 13 21:53:58 user nova-compute[71325]: iface.net_ifacename = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.ipaddress = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.prefix_len = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.hwaddress = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.transport_name = tcp
Apr 13 21:53:58 user nova-compute[71325]: iface.initiatorname = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.state = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.vlan_id = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.vlan_priority = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.vlan_state = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.iface_num = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.mtu = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.port = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.bootproto = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.subnet_mask = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.gateway = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.dhcp_alt_client_id = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.dhcp_dns = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.dhcp_learn_iqn = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.dhcp_vendor_id_state = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.dhcp_vendor_id = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.dhcp_slp_da = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.fragmentation = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.gratuitous_arp = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.incoming_forwarding = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.tos_state = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.tos = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.ttl = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.delayed_ack = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.tcp_nagle = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.tcp_wsf_state = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.tcp_wsf = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.tcp_timer_scale = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.tcp_timestamp = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.redirect = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.def_task_mgmt_timeout = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.header_digest = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.data_digest = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.immediate_data = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.initial_r2t = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.data_seq_inorder = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.data_pdu_inorder = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.erl = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.max_receive_data_len = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.first_burst_len = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.max_outstanding_r2t = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.max_burst_len = 0
Apr 13 21:53:58 user nova-compute[71325]: iface.chap_auth = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.bidi_chap = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.strict_login_compliance = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.discovery_auth = <empty>
Apr 13 21:53:58 user nova-compute[71325]: iface.discovery_logout = <empty>
Apr 13 21:53:58 user nova-compute[71325]: node.discovery_address = <empty>
Apr 13 21:53:58 user nova-compute[71325]: node.discovery_port = 0
Apr 13 21:53:58 user nova-compute[71325]: node.discovery_type = static
Apr 13 21:53:58 user nova-compute[71325]: node.session.initial_cmdsn = 0
Apr 13 21:53:58 user nova-compute[71325]: node.session.initial_login_retry_max = 8
Apr 13 21:53:58 user nova-compute[71325]: node.session.xmit_thread_priority = -20
Apr 13 21:53:58 user nova-compute[71325]: node.session.cmds_max = 128
Apr 13 21:53:58 user nova-compute[71325]: node.session.queue_depth = 32
Apr 13 21:53:58 user nova-compute[71325]: node.session.nr_sessions = 1
Apr 13 21:53:58 user nova-compute[71325]: node.session.auth.authmethod = CHAP
Apr 13 21:53:58 user nova-compute[71325]: node.session.auth.username = gVSNAbZE
Apr 13 21:53:58 user nova-compute[71325]: node.session.auth.password = ***
Apr 13 21:53:58 user nova-compute[71325]: node.session.auth.username_in = <empty>
Apr 13 21:53:58 user nova-compute[71325]: node.session.auth.password_in = <empty>
Apr 13 21:53:58 user nova-compute[71325]: node.session.auth.chap_algs = MD5
Apr 13 21:53:58 user nova-compute[71325]: node.session.timeo.replacement_timeout = 120
Apr 13 21:53:58 user nova-compute[71325]: node.session.err_timeo.abort_timeout = 15
Apr 13 21:53:58 user nova-compute[71325]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 21:53:58 user nova-compute[71325]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 21:53:58 user nova-compute[71325]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 21:53:58 user nova-compute[71325]: node.session.iscsi.FastAbort = Yes
Apr 13 21:53:58 user nova-compute[71325]: node.session.iscsi.InitialR2T = No
Apr 13 21:53:58 user nova-compute[71325]: node.session.iscsi.ImmediateData = Yes
Apr 13 21:53:58 user nova-compute[71325]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 21:53:58 user nova-compute[71325]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 21:53:58 user nova-compute[71325]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 21:53:58 user nova-compute[71325]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 21:53:58 user nova-compute[71325]: node.session.iscsi.MaxConnections = 1
Apr 13 21:53:58 user nova-compute[71325]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 21:53:58 user nova-compute[71325]: node.session.iscsi.ERL = 0
Apr 13 21:53:58 user nova-compute[71325]: node.session.scan = manual
Apr 13 21:53:58 user nova-compute[71325]: node.session.reopen_max = 0
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].address = 172.16.0.220
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].port = 3260
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].startup = manual
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].tcp.window_size = 524288
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].tcp.type_of_service = 0
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].timeo.logout_timeout = 15
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].timeo.login_timeout = 15
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].timeo.auth_timeout = 45
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].iscsi.DataDigest = None
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].iscsi.IFMarker = No
Apr 13 21:53:58 user nova-compute[71325]: node.conn[0].iscsi.OFMarker = No
Apr 13 21:53:58 user nova-compute[71325]: # END RECORD
Apr 13 21:53:58 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb54845-6b76-4b10-a20b-239857f20176]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c545fb82-55a6-48bc-a863-cc05bee53027]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gVSNAbZE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gVSNAbZE" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[67002de0-a72b-4933-bb00-399c920e0224]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gVSNAbZE'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d2f378-dcc4-479b-9f3c-1ce7e342d72a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[76de4b01-c46a-4ce7-bcab-42d023c883d9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:53:58 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:53:58 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:53:58 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:53:58 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.162s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] HCTL ('35', '0', '0', 0) found on session 21 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed715345-c867-4606-8245-9a5830c21cbc]: (4, ('0 0 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Searching for a device in session 21 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVSNAbZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.190s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] <== connect_volume: return (191ms) {'type': 'block', 'scsi_wwn': '26634393766356666', 'path': '/dev/sdd'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634393766356666', 'path': '/dev/sdd'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1476604230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1476604230',id=19,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:52:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11a30fba887e4114be856d26b47a8e55',ramdisk_id='',reservation_id='r-t2ph803w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-33854562',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:52:19Z,user_data=None,user_id='0ab740920cac4befac62a72f7ce5a817',uuid=6fbf2022-b069-440f-8513-6d107f0a7180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "vif_mac": "fa:16:3e:2f:96:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converting VIF {"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "vif_mac": "fa:16:3e:2f:96:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=fee95846-6886-4a1a-b7cb-53bd1c1977d8,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95846-68') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fbf2022-b069-440f-8513-6d107f0a7180 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:53:58 user nova-compute[71325]:   <uuid>6fbf2022-b069-440f-8513-6d107f0a7180</uuid>
Apr 13 21:53:58 user nova-compute[71325]:   <name>instance-00000013</name>
Apr 13 21:53:58 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:53:58 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:53:58 user nova-compute[71325]:   <metadata>
Apr 13 21:53:58 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:53:58 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:53:58 user nova-compute[71325]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1476604230</nova:name>
Apr 13 21:53:58 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:53:57</nova:creationTime>
Apr 13 21:53:58 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:53:58 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:53:58 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:53:58 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:53:58 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:53:58 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:53:58 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:53:58 user nova-compute[71325]:       <nova:owner>
Apr 13 21:53:58 user nova-compute[71325]:         <nova:user uuid="0ab740920cac4befac62a72f7ce5a817">tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member</nova:user>
Apr 13 21:53:58 user nova-compute[71325]:         <nova:project uuid="11a30fba887e4114be856d26b47a8e55">tempest-ServerBootFromVolumeStableRescueTest-33854562</nova:project>
Apr 13 21:53:58 user nova-compute[71325]:       </nova:owner>
Apr 13 21:53:58 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:53:58 user nova-compute[71325]:       <nova:ports>
Apr 13 21:53:58 user nova-compute[71325]:         <nova:port uuid="fee95846-6886-4a1a-b7cb-53bd1c1977d8">
Apr 13 21:53:58 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 21:53:58 user nova-compute[71325]:         </nova:port>
Apr 13 21:53:58 user nova-compute[71325]:       </nova:ports>
Apr 13 21:53:58 user nova-compute[71325]:     </nova:instance>
Apr 13 21:53:58 user nova-compute[71325]:   </metadata>
Apr 13 21:53:58 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:53:58 user nova-compute[71325]:     <system>
Apr 13 21:53:58 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:53:58 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:53:58 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:53:58 user nova-compute[71325]:       <entry name="serial">6fbf2022-b069-440f-8513-6d107f0a7180</entry>
Apr 13 21:53:58 user nova-compute[71325]:       <entry name="uuid">6fbf2022-b069-440f-8513-6d107f0a7180</entry>
Apr 13 21:53:58 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:53:58 user nova-compute[71325]:     </system>
Apr 13 21:53:58 user nova-compute[71325]:   </sysinfo>
Apr 13 21:53:58 user nova-compute[71325]:   <os>
Apr 13 21:53:58 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:53:58 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:53:58 user nova-compute[71325]:   </os>
Apr 13 21:53:58 user nova-compute[71325]:   <features>
Apr 13 21:53:58 user nova-compute[71325]:     <acpi/>
Apr 13 21:53:58 user nova-compute[71325]:     <apic/>
Apr 13 21:53:58 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:53:58 user nova-compute[71325]:   </features>
Apr 13 21:53:58 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:53:58 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:53:58 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:53:58 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:53:58 user nova-compute[71325]:   </clock>
Apr 13 21:53:58 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:53:58 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:53:58 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:53:58 user nova-compute[71325]:   </cpu>
Apr 13 21:53:58 user nova-compute[71325]:   <devices>
Apr 13 21:53:58 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:53:58 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:53:58 user nova-compute[71325]:       <source dev="/dev/sdd"/>
Apr 13 21:53:58 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:53:58 user nova-compute[71325]:       <serial>2e3f9d31-e4a2-4e3d-9823-819f1c1244ce</serial>
Apr 13 21:53:58 user nova-compute[71325]:     </disk>
Apr 13 21:53:58 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:53:58 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:53:58 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/disk.rescue"/>
Apr 13 21:53:58 user nova-compute[71325]:       <target dev="vdb" bus="virtio"/>
Apr 13 21:53:58 user nova-compute[71325]:       <boot order="1"/>
Apr 13 21:53:58 user nova-compute[71325]:     </disk>
Apr 13 21:53:58 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:53:58 user nova-compute[71325]:       <mac address="fa:16:3e:2f:96:1e"/>
Apr 13 21:53:58 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:53:58 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:53:58 user nova-compute[71325]:       <target dev="tapfee95846-68"/>
Apr 13 21:53:58 user nova-compute[71325]:     </interface>
Apr 13 21:53:58 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:53:58 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/console.log" append="off"/>
Apr 13 21:53:58 user nova-compute[71325]:     </serial>
Apr 13 21:53:58 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:53:58 user nova-compute[71325]:     <video>
Apr 13 21:53:58 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:53:58 user nova-compute[71325]:     </video>
Apr 13 21:53:58 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:53:58 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:53:58 user nova-compute[71325]:     </rng>
Apr 13 21:53:58 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:53:58 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:53:58 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:53:58 user nova-compute[71325]:     </memballoon>
Apr 13 21:53:58 user nova-compute[71325]:   </devices>
Apr 13 21:53:58 user nova-compute[71325]: </domain>
Apr 13 21:53:58 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:53:58 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Instance destroyed successfully.
Apr 13 21:53:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:53:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] No VIF found with MAC fa:16:3e:2f:96:1e, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:53:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:53:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-c4e10830-d3e8-498e-be12-952d522638af req-1fe6347b-f61c-4bcf-975b-c0e482299e87 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c4e10830-d3e8-498e-be12-952d522638af req-1fe6347b-f61c-4bcf-975b-c0e482299e87 service nova] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c4e10830-d3e8-498e-be12-952d522638af req-1fe6347b-f61c-4bcf-975b-c0e482299e87 service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c4e10830-d3e8-498e-be12-952d522638af req-1fe6347b-f61c-4bcf-975b-c0e482299e87 service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-c4e10830-d3e8-498e-be12-952d522638af req-1fe6347b-f61c-4bcf-975b-c0e482299e87 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] No waiting events found dispatching network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:00 user nova-compute[71325]: WARNING nova.compute.manager [req-c4e10830-d3e8-498e-be12-952d522638af req-1fe6347b-f61c-4bcf-975b-c0e482299e87 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received unexpected event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance with vm_state active and task_state rescuing.
Apr 13 21:54:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:02 user nova-compute[71325]: DEBUG nova.compute.manager [req-5a5f9658-9169-4eea-8980-3e65070eed34 req-f9583d4b-c14d-4407-8d26-a8b003e298ab service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5a5f9658-9169-4eea-8980-3e65070eed34 req-f9583d4b-c14d-4407-8d26-a8b003e298ab service nova] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5a5f9658-9169-4eea-8980-3e65070eed34 req-f9583d4b-c14d-4407-8d26-a8b003e298ab service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5a5f9658-9169-4eea-8980-3e65070eed34 req-f9583d4b-c14d-4407-8d26-a8b003e298ab service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:02 user nova-compute[71325]: DEBUG nova.compute.manager [req-5a5f9658-9169-4eea-8980-3e65070eed34 req-f9583d4b-c14d-4407-8d26-a8b003e298ab service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] No waiting events found dispatching network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:02 user nova-compute[71325]: WARNING nova.compute.manager [req-5a5f9658-9169-4eea-8980-3e65070eed34 req-f9583d4b-c14d-4407-8d26-a8b003e298ab service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received unexpected event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance with vm_state active and task_state rescuing.
Apr 13 21:54:02 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for 6fbf2022-b069-440f-8513-6d107f0a7180 due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:54:02 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422842.3104298, 6fbf2022-b069-440f-8513-6d107f0a7180 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:54:02 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] VM Resumed (Lifecycle Event)
Apr 13 21:54:02 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:02 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:02 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:54:02 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 21:54:02 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422842.3109193, 6fbf2022-b069-440f-8513-6d107f0a7180 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:54:02 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] VM Started (Lifecycle Event)
Apr 13 21:54:02 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:02 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:54:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:06 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:54:06 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:54:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:54:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:54:06 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:54:06 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422831.9089446, 8645ede7-1e10-4520-8092-6cc6dfc3d82a => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:54:06 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] VM Stopped (Lifecycle Event)
Apr 13 21:54:06 user nova-compute[71325]: DEBUG nova.compute.manager [None req-f14cc649-acd2-425f-bc69-75b90cc1a4a8 None None] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:07 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Updating instance_info_cache with network_info: [{"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:54:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:54:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:54:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:54:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:54:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:54:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:54:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:54:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:07 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:54:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:54:09 user nova-compute[71325]: INFO nova.compute.claims [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Claim successful on node user
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.614s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG nova.network.neutron [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:10 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:54:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG nova.policy [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fe6b951236f4a96a2ac12a5dea4602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd2e9bf0c5345f6bd3f030fb9f55e03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:54:10 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Creating image(s)
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "/opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "/opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.151s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/disk 1073741824" returned: 0 in 0.056s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Cannot resize image /opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:54:11 user nova-compute[71325]: DEBUG nova.objects.instance [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lazy-loading 'migration_context' on Instance uuid a3489f51-3982-4ddd-9a38-fde0b31e5b45 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.network.neutron [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Successfully created port: 0dee1237-d171-40d9-ab20-6744df05223b {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Ensure instance console log exists: /opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:12 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:54:12 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7523MB free_disk=26.178546905517578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 03554793-01dd-4629-97c7-b640f5934639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.network.neutron [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Successfully updated port: 0dee1237-d171-40d9-ab20-6744df05223b {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "refresh_cache-a3489f51-3982-4ddd-9a38-fde0b31e5b45" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquired lock "refresh_cache-a3489f51-3982-4ddd-9a38-fde0b31e5b45" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.network.neutron [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-904c4b12-3940-409a-b2bc-59a011d42479 req-c10ae2f1-3277-4b39-a538-4b50c881d2d6 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Received event network-changed-0dee1237-d171-40d9-ab20-6744df05223b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-904c4b12-3940-409a-b2bc-59a011d42479 req-c10ae2f1-3277-4b39-a538-4b50c881d2d6 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Refreshing instance network info cache due to event network-changed-0dee1237-d171-40d9-ab20-6744df05223b. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:54:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-904c4b12-3940-409a-b2bc-59a011d42479 req-c10ae2f1-3277-4b39-a538-4b50c881d2d6 service nova] Acquiring lock "refresh_cache-a3489f51-3982-4ddd-9a38-fde0b31e5b45" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.network.neutron [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.network.neutron [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Updating instance_info_cache with network_info: [{"id": "0dee1237-d171-40d9-ab20-6744df05223b", "address": "fa:16:3e:40:24:a0", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dee1237-d1", "ovs_interfaceid": "0dee1237-d171-40d9-ab20-6744df05223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Releasing lock "refresh_cache-a3489f51-3982-4ddd-9a38-fde0b31e5b45" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Instance network_info: |[{"id": "0dee1237-d171-40d9-ab20-6744df05223b", "address": "fa:16:3e:40:24:a0", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dee1237-d1", "ovs_interfaceid": "0dee1237-d171-40d9-ab20-6744df05223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-904c4b12-3940-409a-b2bc-59a011d42479 req-c10ae2f1-3277-4b39-a538-4b50c881d2d6 service nova] Acquired lock "refresh_cache-a3489f51-3982-4ddd-9a38-fde0b31e5b45" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.network.neutron [req-904c4b12-3940-409a-b2bc-59a011d42479 req-c10ae2f1-3277-4b39-a538-4b50c881d2d6 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Refreshing network info cache for port 0dee1237-d171-40d9-ab20-6744df05223b {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Start _get_guest_xml network_info=[{"id": "0dee1237-d171-40d9-ab20-6744df05223b", "address": "fa:16:3e:40:24:a0", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dee1237-d1", "ovs_interfaceid": "0dee1237-d171-40d9-ab20-6744df05223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:54:13 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:54:13 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:54:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-38090163',display_name='tempest-VolumesActionsTest-instance-38090163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-38090163',id=24,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efd2e9bf0c5345f6bd3f030fb9f55e03',ramdisk_id='',reservation_id='r-uschs1zs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1838938247',owner_user_name='tempest-VolumesActionsTest-1838938247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:54:11Z,user_data=None,user_id='9fe6b951236f4a96a2ac12a5dea4602a',uuid=a3489f51-3982-4ddd-9a38-fde0b31e5b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dee1237-d171-40d9-ab20-6744df05223b", "address": "fa:16:3e:40:24:a0", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dee1237-d1", "ovs_interfaceid": "0dee1237-d171-40d9-ab20-6744df05223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Converting VIF {"id": "0dee1237-d171-40d9-ab20-6744df05223b", "address": "fa:16:3e:40:24:a0", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dee1237-d1", "ovs_interfaceid": "0dee1237-d171-40d9-ab20-6744df05223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:24:a0,bridge_name='br-int',has_traffic_filtering=True,id=0dee1237-d171-40d9-ab20-6744df05223b,network=Network(dd758252-0db3-4d47-a231-c8a85e067e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dee1237-d1') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.objects.instance [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lazy-loading 'pci_devices' on Instance uuid a3489f51-3982-4ddd-9a38-fde0b31e5b45 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:54:13 user nova-compute[71325]:   <uuid>a3489f51-3982-4ddd-9a38-fde0b31e5b45</uuid>
Apr 13 21:54:13 user nova-compute[71325]:   <name>instance-00000018</name>
Apr 13 21:54:13 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:54:13 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:54:13 user nova-compute[71325]:   <metadata>
Apr 13 21:54:13 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:54:13 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:54:13 user nova-compute[71325]:       <nova:name>tempest-VolumesActionsTest-instance-38090163</nova:name>
Apr 13 21:54:13 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:54:13</nova:creationTime>
Apr 13 21:54:13 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:54:13 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:54:13 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:54:13 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:54:13 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:54:13 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:54:13 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:54:13 user nova-compute[71325]:       <nova:owner>
Apr 13 21:54:13 user nova-compute[71325]:         <nova:user uuid="9fe6b951236f4a96a2ac12a5dea4602a">tempest-VolumesActionsTest-1838938247-project-member</nova:user>
Apr 13 21:54:13 user nova-compute[71325]:         <nova:project uuid="efd2e9bf0c5345f6bd3f030fb9f55e03">tempest-VolumesActionsTest-1838938247</nova:project>
Apr 13 21:54:13 user nova-compute[71325]:       </nova:owner>
Apr 13 21:54:13 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:54:13 user nova-compute[71325]:       <nova:ports>
Apr 13 21:54:13 user nova-compute[71325]:         <nova:port uuid="0dee1237-d171-40d9-ab20-6744df05223b">
Apr 13 21:54:13 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 21:54:13 user nova-compute[71325]:         </nova:port>
Apr 13 21:54:13 user nova-compute[71325]:       </nova:ports>
Apr 13 21:54:13 user nova-compute[71325]:     </nova:instance>
Apr 13 21:54:13 user nova-compute[71325]:   </metadata>
Apr 13 21:54:13 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:54:13 user nova-compute[71325]:     <system>
Apr 13 21:54:13 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:54:13 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:54:13 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:54:13 user nova-compute[71325]:       <entry name="serial">a3489f51-3982-4ddd-9a38-fde0b31e5b45</entry>
Apr 13 21:54:13 user nova-compute[71325]:       <entry name="uuid">a3489f51-3982-4ddd-9a38-fde0b31e5b45</entry>
Apr 13 21:54:13 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:54:13 user nova-compute[71325]:     </system>
Apr 13 21:54:13 user nova-compute[71325]:   </sysinfo>
Apr 13 21:54:13 user nova-compute[71325]:   <os>
Apr 13 21:54:13 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:54:13 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:54:13 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:54:13 user nova-compute[71325]:   </os>
Apr 13 21:54:13 user nova-compute[71325]:   <features>
Apr 13 21:54:13 user nova-compute[71325]:     <acpi/>
Apr 13 21:54:13 user nova-compute[71325]:     <apic/>
Apr 13 21:54:13 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:54:13 user nova-compute[71325]:   </features>
Apr 13 21:54:13 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:54:13 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:54:13 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:54:13 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:54:13 user nova-compute[71325]:   </clock>
Apr 13 21:54:13 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:54:13 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:54:13 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:54:13 user nova-compute[71325]:   </cpu>
Apr 13 21:54:13 user nova-compute[71325]:   <devices>
Apr 13 21:54:13 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:54:13 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:54:13 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/disk"/>
Apr 13 21:54:13 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:54:13 user nova-compute[71325]:     </disk>
Apr 13 21:54:13 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:54:13 user nova-compute[71325]:       <mac address="fa:16:3e:40:24:a0"/>
Apr 13 21:54:13 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:54:13 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:54:13 user nova-compute[71325]:       <target dev="tap0dee1237-d1"/>
Apr 13 21:54:13 user nova-compute[71325]:     </interface>
Apr 13 21:54:13 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:54:13 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/console.log" append="off"/>
Apr 13 21:54:13 user nova-compute[71325]:     </serial>
Apr 13 21:54:13 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:54:13 user nova-compute[71325]:     <video>
Apr 13 21:54:13 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:54:13 user nova-compute[71325]:     </video>
Apr 13 21:54:13 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:54:13 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:54:13 user nova-compute[71325]:     </rng>
Apr 13 21:54:13 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:54:13 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:54:13 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:54:13 user nova-compute[71325]:     </memballoon>
Apr 13 21:54:13 user nova-compute[71325]:   </devices>
Apr 13 21:54:13 user nova-compute[71325]: </domain>
Apr 13 21:54:13 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:54:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-38090163',display_name='tempest-VolumesActionsTest-instance-38090163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-38090163',id=24,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efd2e9bf0c5345f6bd3f030fb9f55e03',ramdisk_id='',reservation_id='r-uschs1zs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1838938247',owner_user_name='tempest-VolumesActionsTest-1838938247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:54:11Z,user_data=None,user_id='9fe6b951236f4a96a2ac12a5dea4602a',uuid=a3489f51-3982-4ddd-9a38-fde0b31e5b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dee1237-d171-40d9-ab20-6744df05223b", "address": "fa:16:3e:40:24:a0", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dee1237-d1", "ovs_interfaceid": "0dee1237-d171-40d9-ab20-6744df05223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Converting VIF {"id": "0dee1237-d171-40d9-ab20-6744df05223b", "address": "fa:16:3e:40:24:a0", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dee1237-d1", "ovs_interfaceid": "0dee1237-d171-40d9-ab20-6744df05223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:24:a0,bridge_name='br-int',has_traffic_filtering=True,id=0dee1237-d171-40d9-ab20-6744df05223b,network=Network(dd758252-0db3-4d47-a231-c8a85e067e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dee1237-d1') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG os_vif [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:24:a0,bridge_name='br-int',has_traffic_filtering=True,id=0dee1237-d171-40d9-ab20-6744df05223b,network=Network(dd758252-0db3-4d47-a231-c8a85e067e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dee1237-d1') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dee1237-d1, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0dee1237-d1, col_values=(('external_ids', {'iface-id': '0dee1237-d171-40d9-ab20-6744df05223b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:24:a0', 'vm-uuid': 'a3489f51-3982-4ddd-9a38-fde0b31e5b45'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:54:13 user nova-compute[71325]: INFO os_vif [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:24:a0,bridge_name='br-int',has_traffic_filtering=True,id=0dee1237-d171-40d9-ab20-6744df05223b,network=Network(dd758252-0db3-4d47-a231-c8a85e067e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dee1237-d1')
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] No VIF found with MAC fa:16:3e:40:24:a0, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.network.neutron [req-904c4b12-3940-409a-b2bc-59a011d42479 req-c10ae2f1-3277-4b39-a538-4b50c881d2d6 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Updated VIF entry in instance network info cache for port 0dee1237-d171-40d9-ab20-6744df05223b. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG nova.network.neutron [req-904c4b12-3940-409a-b2bc-59a011d42479 req-c10ae2f1-3277-4b39-a538-4b50c881d2d6 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Updating instance_info_cache with network_info: [{"id": "0dee1237-d171-40d9-ab20-6744df05223b", "address": "fa:16:3e:40:24:a0", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dee1237-d1", "ovs_interfaceid": "0dee1237-d171-40d9-ab20-6744df05223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:54:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-904c4b12-3940-409a-b2bc-59a011d42479 req-c10ae2f1-3277-4b39-a538-4b50c881d2d6 service nova] Releasing lock "refresh_cache-a3489f51-3982-4ddd-9a38-fde0b31e5b45" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:54:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-58e426f2-3b74-473d-b618-bffcbdb7b477 req-196af144-46ac-405c-af6d-4cfefb2f8936 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Received event network-vif-plugged-0dee1237-d171-40d9-ab20-6744df05223b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-58e426f2-3b74-473d-b618-bffcbdb7b477 req-196af144-46ac-405c-af6d-4cfefb2f8936 service nova] Acquiring lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-58e426f2-3b74-473d-b618-bffcbdb7b477 req-196af144-46ac-405c-af6d-4cfefb2f8936 service nova] Lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-58e426f2-3b74-473d-b618-bffcbdb7b477 req-196af144-46ac-405c-af6d-4cfefb2f8936 service nova] Lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-58e426f2-3b74-473d-b618-bffcbdb7b477 req-196af144-46ac-405c-af6d-4cfefb2f8936 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] No waiting events found dispatching network-vif-plugged-0dee1237-d171-40d9-ab20-6744df05223b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:15 user nova-compute[71325]: WARNING nova.compute.manager [req-58e426f2-3b74-473d-b618-bffcbdb7b477 req-196af144-46ac-405c-af6d-4cfefb2f8936 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Received unexpected event network-vif-plugged-0dee1237-d171-40d9-ab20-6744df05223b for instance with vm_state building and task_state spawning.
Apr 13 21:54:16 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:54:16 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:54:16 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:54:16 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-acdd5e09-2e91-4ada-8853-c5d97f014f8e req-407f9891-fef6-4f0e-b29d-0873bcee6818 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Received event network-vif-plugged-0dee1237-d171-40d9-ab20-6744df05223b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acdd5e09-2e91-4ada-8853-c5d97f014f8e req-407f9891-fef6-4f0e-b29d-0873bcee6818 service nova] Acquiring lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acdd5e09-2e91-4ada-8853-c5d97f014f8e req-407f9891-fef6-4f0e-b29d-0873bcee6818 service nova] Lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acdd5e09-2e91-4ada-8853-c5d97f014f8e req-407f9891-fef6-4f0e-b29d-0873bcee6818 service nova] Lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-acdd5e09-2e91-4ada-8853-c5d97f014f8e req-407f9891-fef6-4f0e-b29d-0873bcee6818 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] No waiting events found dispatching network-vif-plugged-0dee1237-d171-40d9-ab20-6744df05223b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:17 user nova-compute[71325]: WARNING nova.compute.manager [req-acdd5e09-2e91-4ada-8853-c5d97f014f8e req-407f9891-fef6-4f0e-b29d-0873bcee6818 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Received unexpected event network-vif-plugged-0dee1237-d171-40d9-ab20-6744df05223b for instance with vm_state building and task_state spawning.
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422857.2222848, a3489f51-3982-4ddd-9a38-fde0b31e5b45 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:54:17 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] VM Resumed (Lifecycle Event)
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:54:17 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Instance spawned successfully.
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:54:17 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422857.2233427, a3489f51-3982-4ddd-9a38-fde0b31e5b45 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:54:17 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] VM Started (Lifecycle Event)
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:54:17 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:54:17 user nova-compute[71325]: INFO nova.compute.manager [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Took 6.51 seconds to spawn the instance on the hypervisor.
Apr 13 21:54:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:17 user nova-compute[71325]: INFO nova.compute.manager [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Took 7.60 seconds to build instance.
Apr 13 21:54:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.730s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "03554793-01dd-4629-97c7-b640f5934639" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG nova.objects.instance [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'flavor' on Instance uuid 03554793-01dd-4629-97c7-b640f5934639 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "03554793-01dd-4629-97c7-b640f5934639" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "03554793-01dd-4629-97c7-b640f5934639" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:23 user nova-compute[71325]: INFO nova.compute.manager [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Attaching volume 95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 to /dev/vdb
Apr 13 21:54:23 user nova-compute[71325]: DEBUG os_brick.utils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7300e7-9449-4b5b-b693-54078be2ccd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[274d23c0-cf7e-4156-ad15-598dcba320c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7247ce-9b4f-4398-b4e6-0e22e039145e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdb5cc8-c7d3-44ce-abe3-aee6e7a480a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:54:23 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:54:23 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4b3a6c-a78a-4679-b977-c2de7b5bc88a]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG os_brick.utils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:54:23 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Updating existing volume attachment record: 0d7c3b9c-e61d-46a2-8e1e-ca7c1385503e {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:54:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfxYihPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:54:29 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:54:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:54:29 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:54:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:54:29 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4ef78b-1650-405e-b9cc-273cbb6d3680]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:54:29 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.050s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a8e0be-9521-49fd-9d3a-1c7d04e1b4d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4] added
Apr 13 21:54:29 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1a6d7f-ae42-4780-aabd-0894fc4399b6]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcee4eb-cc7a-4e67-abe7-7135127653be]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UfxYihPJ {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UfxYihPJ" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[83807577-01f0-44ff-92fd-c4d5ec6ddadd]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UfxYihPJ'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5518eaa9-7ecc-4252-87de-f3cdf73378ac]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9261be57-c6ab-4ca5-bb19-9091c038f29a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:54:29 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:54:29 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:54:29 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:54:29 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:54:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[694fd5d5-74f7-4051-b6f9-7a9c24911f3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4, portal: 172.16.0.220,3260]
Apr 13 21:54:30 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4, portal: 172.16.0.220,3260] successful.
Apr 13 21:54:30 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4de8220-575d-4a53-9496-a445b23d0d1d]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e315425-3198-449b-8fd9-e0750e53bb58]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:54:30 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:54:30 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:54:30 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:54:30 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:54:30 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:54:30 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7d0fdf-e3e2-4bf5-8cf5-b627ebb33819]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:54:30 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:54:31 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:54:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfxYihPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:54:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:54:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23437353831343761', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:54:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437353831343761', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:54:31 user nova-compute[71325]: DEBUG nova.objects.instance [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'flavor' on Instance uuid 03554793-01dd-4629-97c7-b640f5934639 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:54:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:54:31 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:54:31 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 21:54:31 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:54:31 user nova-compute[71325]:   <serial>95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4</serial>
Apr 13 21:54:31 user nova-compute[71325]: </disk>
Apr 13 21:54:31 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:54:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:54:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:54:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] No VIF found with MAC fa:16:3e:63:fe:50, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:54:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "03554793-01dd-4629-97c7-b640f5934639" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.669s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-27401d90-22d2-4dd7-abce-e8af66f68d69 req-2198badd-d02c-4b18-9720-9707ed9f1d47 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received event network-changed-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-27401d90-22d2-4dd7-abce-e8af66f68d69 req-2198badd-d02c-4b18-9720-9707ed9f1d47 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Refreshing instance network info cache due to event network-changed-596fdd61-68e0-4968-9d6a-e70d32a61ea1. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:54:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-27401d90-22d2-4dd7-abce-e8af66f68d69 req-2198badd-d02c-4b18-9720-9707ed9f1d47 service nova] Acquiring lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:54:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-27401d90-22d2-4dd7-abce-e8af66f68d69 req-2198badd-d02c-4b18-9720-9707ed9f1d47 service nova] Acquired lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:54:32 user nova-compute[71325]: DEBUG nova.network.neutron [req-27401d90-22d2-4dd7-abce-e8af66f68d69 req-2198badd-d02c-4b18-9720-9707ed9f1d47 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Refreshing network info cache for port 596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:54:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:33 user nova-compute[71325]: DEBUG nova.network.neutron [req-27401d90-22d2-4dd7-abce-e8af66f68d69 req-2198badd-d02c-4b18-9720-9707ed9f1d47 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Updated VIF entry in instance network info cache for port 596fdd61-68e0-4968-9d6a-e70d32a61ea1. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:54:33 user nova-compute[71325]: DEBUG nova.network.neutron [req-27401d90-22d2-4dd7-abce-e8af66f68d69 req-2198badd-d02c-4b18-9720-9707ed9f1d47 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Updating instance_info_cache with network_info: [{"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:54:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-27401d90-22d2-4dd7-abce-e8af66f68d69 req-2198badd-d02c-4b18-9720-9707ed9f1d47 service nova] Releasing lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:54:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:35 user nova-compute[71325]: DEBUG nova.compute.manager [req-9a88ad08-c453-4b0f-8617-b84f5c212492 req-add6aa1f-ac1f-4355-87c1-227a279cfb90 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-changed-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:35 user nova-compute[71325]: DEBUG nova.compute.manager [req-9a88ad08-c453-4b0f-8617-b84f5c212492 req-add6aa1f-ac1f-4355-87c1-227a279cfb90 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Refreshing instance network info cache due to event network-changed-0150fcfb-793e-4d51-966c-c30195a9802f. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:54:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9a88ad08-c453-4b0f-8617-b84f5c212492 req-add6aa1f-ac1f-4355-87c1-227a279cfb90 service nova] Acquiring lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:54:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9a88ad08-c453-4b0f-8617-b84f5c212492 req-add6aa1f-ac1f-4355-87c1-227a279cfb90 service nova] Acquired lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:54:35 user nova-compute[71325]: DEBUG nova.network.neutron [req-9a88ad08-c453-4b0f-8617-b84f5c212492 req-add6aa1f-ac1f-4355-87c1-227a279cfb90 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Refreshing network info cache for port 0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:54:35 user nova-compute[71325]: DEBUG nova.network.neutron [req-9a88ad08-c453-4b0f-8617-b84f5c212492 req-add6aa1f-ac1f-4355-87c1-227a279cfb90 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Updated VIF entry in instance network info cache for port 0150fcfb-793e-4d51-966c-c30195a9802f. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:54:35 user nova-compute[71325]: DEBUG nova.network.neutron [req-9a88ad08-c453-4b0f-8617-b84f5c212492 req-add6aa1f-ac1f-4355-87c1-227a279cfb90 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Updating instance_info_cache with network_info: [{"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:54:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9a88ad08-c453-4b0f-8617-b84f5c212492 req-add6aa1f-ac1f-4355-87c1-227a279cfb90 service nova] Releasing lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:54:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:35 user nova-compute[71325]: INFO nova.compute.manager [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Shelving
Apr 13 21:54:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:36 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Instance destroyed successfully.
Apr 13 21:54:36 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Beginning cold snapshot process
Apr 13 21:54:36 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:54:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk /opt/stack/data/nova/instances/snapshots/tmpr3c4pd7e/5bfca4c1f25d42b792d42f6ae9e2156e {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:54:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received event network-vif-unplugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] Acquiring lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] No waiting events found dispatching network-vif-unplugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:37 user nova-compute[71325]: WARNING nova.compute.manager [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received unexpected event network-vif-unplugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance with vm_state active and task_state shelving_image_pending_upload.
Apr 13 21:54:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received event network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] Acquiring lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] No waiting events found dispatching network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:37 user nova-compute[71325]: WARNING nova.compute.manager [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received unexpected event network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance with vm_state active and task_state shelving_image_pending_upload.
Apr 13 21:54:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk /opt/stack/data/nova/instances/snapshots/tmpr3c4pd7e/5bfca4c1f25d42b792d42f6ae9e2156e" returned: 0 in 0.679s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:54:37 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Snapshot extracted, beginning image upload
Apr 13 21:54:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-2770dc19-aba6-45e3-98ff-946352e07288 req-079eb42d-9305-4723-9520-9d0f44a9f2d6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-changed-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-2770dc19-aba6-45e3-98ff-946352e07288 req-079eb42d-9305-4723-9520-9d0f44a9f2d6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Refreshing instance network info cache due to event network-changed-0150fcfb-793e-4d51-966c-c30195a9802f. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:54:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2770dc19-aba6-45e3-98ff-946352e07288 req-079eb42d-9305-4723-9520-9d0f44a9f2d6 service nova] Acquiring lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:54:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2770dc19-aba6-45e3-98ff-946352e07288 req-079eb42d-9305-4723-9520-9d0f44a9f2d6 service nova] Acquired lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:54:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-2770dc19-aba6-45e3-98ff-946352e07288 req-079eb42d-9305-4723-9520-9d0f44a9f2d6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Refreshing network info cache for port 0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:54:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "03554793-01dd-4629-97c7-b640f5934639" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:38 user nova-compute[71325]: INFO nova.compute.manager [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Rebooting instance
Apr 13 21:54:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:54:38 user nova-compute[71325]: DEBUG nova.network.neutron [req-2770dc19-aba6-45e3-98ff-946352e07288 req-079eb42d-9305-4723-9520-9d0f44a9f2d6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Updated VIF entry in instance network info cache for port 0150fcfb-793e-4d51-966c-c30195a9802f. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:54:38 user nova-compute[71325]: DEBUG nova.network.neutron [req-2770dc19-aba6-45e3-98ff-946352e07288 req-079eb42d-9305-4723-9520-9d0f44a9f2d6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Updating instance_info_cache with network_info: [{"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:54:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2770dc19-aba6-45e3-98ff-946352e07288 req-079eb42d-9305-4723-9520-9d0f44a9f2d6 service nova] Releasing lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:54:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquired lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:54:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:54:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Updating instance_info_cache with network_info: [{"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:54:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Releasing lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:54:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:39 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Snapshot image upload complete
Apr 13 21:54:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:39 user nova-compute[71325]: INFO nova.compute.manager [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Shelve offloading
Apr 13 21:54:39 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Instance destroyed successfully.
Apr 13 21:54:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:54:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquired lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:54:39 user nova-compute[71325]: DEBUG nova.network.neutron [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:54:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:40 user nova-compute[71325]: INFO nova.compute.manager [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Terminating instance
Apr 13 21:54:40 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-7099a724-f228-4338-8d23-6abd6ad4d838 req-94809cb3-7105-465c-a12a-9b21e60087b3 service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-vif-unplugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7099a724-f228-4338-8d23-6abd6ad4d838 req-94809cb3-7105-465c-a12a-9b21e60087b3 service nova] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7099a724-f228-4338-8d23-6abd6ad4d838 req-94809cb3-7105-465c-a12a-9b21e60087b3 service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7099a724-f228-4338-8d23-6abd6ad4d838 req-94809cb3-7105-465c-a12a-9b21e60087b3 service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-7099a724-f228-4338-8d23-6abd6ad4d838 req-94809cb3-7105-465c-a12a-9b21e60087b3 service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] No waiting events found dispatching network-vif-unplugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-7099a724-f228-4338-8d23-6abd6ad4d838 req-94809cb3-7105-465c-a12a-9b21e60087b3 service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-vif-unplugged-a70898ac-83fd-4f25-be37-aef7c87f6059 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG nova.network.neutron [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Updating instance_info_cache with network_info: [{"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Releasing lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:54:40 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Instance destroyed successfully.
Apr 13 21:54:40 user nova-compute[71325]: DEBUG nova.objects.instance [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'resources' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-140399517',display_name='tempest-AttachVolumeTestJSON-server-140399517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-140399517',id=3,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtoB3nR0JKHa6Ky1vXPwyI7w+rB3Ypa07sW6QVuaj3CXiFeuqRSmd55pQSr/lvFo9l5efcEiAn2oFJFeJlQXi0+ollyvkUFol9Z6nrTwTO2rVl/RiddJVHfv6WKf61UrQ==',key_name='tempest-keypair-789187285',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:45:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3605d609b52b431993bcea0798a77554',ramdisk_id='',reservation_id='r-gimed3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-249879422',owner_user_name='tempest-AttachVolumeTestJSON-249879422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:52:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60e4dadf9d9e41e6a91ee03a0cd50dc3',uuid=ddc7aa71-95a1-4a3c-a5c1-746b86a011c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converting VIF {"id": "a70898ac-83fd-4f25-be37-aef7c87f6059", "address": "fa:16:3e:fd:52:e7", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa70898ac-83", "ovs_interfaceid": "a70898ac-83fd-4f25-be37-aef7c87f6059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG os_vif [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa70898ac-83, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:40 user nova-compute[71325]: INFO os_vif [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:52:e7,bridge_name='br-int',has_traffic_filtering=True,id=a70898ac-83fd-4f25-be37-aef7c87f6059,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa70898ac-83')
Apr 13 21:54:40 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Deleting instance files /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2_del
Apr 13 21:54:40 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Deletion of /opt/stack/data/nova/instances/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2_del complete
Apr 13 21:54:40 user nova-compute[71325]: INFO nova.compute.manager [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 13 21:54:40 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:54:40 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:41 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Instance destroyed successfully.
Apr 13 21:54:41 user nova-compute[71325]: DEBUG nova.objects.instance [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'resources' on Instance uuid 2d1990a1-40ec-4c02-941f-813c22e8cd8f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1709500779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1709500779',id=21,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXhPPymVnGsGI8iPnkTaRKfPT/rUDm48QkxOPI6ZWHXQz9atCTXJ29rrIJZqJqbdFj0MEal6JqZMkPR7ZgeYnFdlqc8HBwjKnYEiOmGpjFVUDqtFqGBgnihI4QoBsFC8Q==',key_name='tempest-keypair-1268128451',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='73c23bc3e8b14441b4622095502b5dae',ramdisk_id='',reservation_id='r-j68sz1ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-710815470',owner_user_name='tempest-AttachVolumeShelveTestJSON-710815470-project-member',shelved_at='2023-04-13T21:54:39.803689',shelved_host='user',shelved_image_id='f514bce4-97a1-4dc6-b168-c629de2da778'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:54:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f151b673e3d47acb9c3ed9b9ecaf687',uuid=2d1990a1-40ec-4c02-941f-813c22e8cd8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converting VIF {"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:f3,bridge_name='br-int',has_traffic_filtering=True,id=596fdd61-68e0-4968-9d6a-e70d32a61ea1,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596fdd61-68') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG os_vif [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:f3,bridge_name='br-int',has_traffic_filtering=True,id=596fdd61-68e0-4968-9d6a-e70d32a61ea1,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596fdd61-68') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap596fdd61-68, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:41 user nova-compute[71325]: INFO os_vif [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:f3,bridge_name='br-int',has_traffic_filtering=True,id=596fdd61-68e0-4968-9d6a-e70d32a61ea1,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596fdd61-68')
Apr 13 21:54:41 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Deleting instance files /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f_del
Apr 13 21:54:41 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Deletion of /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f_del complete
Apr 13 21:54:41 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Deleted allocations for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f
Apr 13 21:54:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-b32accde-e7dd-42ab-b56a-1a9319c9a51a req-3e7a0c86-781b-41db-b986-d8fb81d03315 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-vif-unplugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b32accde-e7dd-42ab-b56a-1a9319c9a51a req-3e7a0c86-781b-41db-b986-d8fb81d03315 service nova] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b32accde-e7dd-42ab-b56a-1a9319c9a51a req-3e7a0c86-781b-41db-b986-d8fb81d03315 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b32accde-e7dd-42ab-b56a-1a9319c9a51a req-3e7a0c86-781b-41db-b986-d8fb81d03315 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-b32accde-e7dd-42ab-b56a-1a9319c9a51a req-3e7a0c86-781b-41db-b986-d8fb81d03315 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] No waiting events found dispatching network-vif-unplugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:41 user nova-compute[71325]: WARNING nova.compute.manager [req-b32accde-e7dd-42ab-b56a-1a9319c9a51a req-3e7a0c86-781b-41db-b986-d8fb81d03315 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received unexpected event network-vif-unplugged-0150fcfb-793e-4d51-966c-c30195a9802f for instance with vm_state active and task_state reboot_started.
Apr 13 21:54:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG nova.objects.instance [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'numa_topology' on Instance uuid 2d1990a1-40ec-4c02-941f-813c22e8cd8f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Instance shutdown successfully.
Apr 13 21:54:42 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:54:42 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Took 1.19 seconds to deallocate network for instance.
Apr 13 21:54:42 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.534s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:42 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Deleted allocations for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2
Apr 13 21:54:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-61bebde5-aad5-4098-847a-e615bef8bf24 req-f625bf7d-59bf-47b6-83f0-61405ca85d1a service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-61bebde5-aad5-4098-847a-e615bef8bf24 req-f625bf7d-59bf-47b6-83f0-61405ca85d1a service nova] Acquiring lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-61bebde5-aad5-4098-847a-e615bef8bf24 req-f625bf7d-59bf-47b6-83f0-61405ca85d1a service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-61bebde5-aad5-4098-847a-e615bef8bf24 req-f625bf7d-59bf-47b6-83f0-61405ca85d1a service nova] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-61bebde5-aad5-4098-847a-e615bef8bf24 req-f625bf7d-59bf-47b6-83f0-61405ca85d1a service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] No waiting events found dispatching network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:42 user nova-compute[71325]: WARNING nova.compute.manager [req-61bebde5-aad5-4098-847a-e615bef8bf24 req-f625bf7d-59bf-47b6-83f0-61405ca85d1a service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received unexpected event network-vif-plugged-a70898ac-83fd-4f25-be37-aef7c87f6059 for instance with vm_state deleted and task_state None.
Apr 13 21:54:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.519s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Received event network-vif-deleted-a70898ac-83fd-4f25-be37-aef7c87f6059 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] No waiting events found dispatching network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:43 user nova-compute[71325]: WARNING nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received unexpected event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f for instance with vm_state active and task_state reboot_started.
Apr 13 21:54:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] No waiting events found dispatching network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:43 user nova-compute[71325]: WARNING nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received unexpected event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f for instance with vm_state active and task_state reboot_started.
Apr 13 21:54:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] No waiting events found dispatching network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:43 user nova-compute[71325]: WARNING nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received unexpected event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f for instance with vm_state active and task_state reboot_started.
Apr 13 21:54:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-vif-unplugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] No waiting events found dispatching network-vif-unplugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:43 user nova-compute[71325]: WARNING nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received unexpected event network-vif-unplugged-0150fcfb-793e-4d51-966c-c30195a9802f for instance with vm_state active and task_state reboot_started.
Apr 13 21:54:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] No waiting events found dispatching network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:43 user nova-compute[71325]: WARNING nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received unexpected event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f for instance with vm_state active and task_state reboot_started.
Apr 13 21:54:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] No waiting events found dispatching network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:43 user nova-compute[71325]: WARNING nova.compute.manager [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received unexpected event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f for instance with vm_state active and task_state reboot_started.
Apr 13 21:54:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:45 user nova-compute[71325]: DEBUG nova.compute.manager [req-022a21b3-861e-4079-a222-70af42cdfa38 req-39a1cb6b-393b-419b-8a83-4021b36f6dbc service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:54:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-022a21b3-861e-4079-a222-70af42cdfa38 req-39a1cb6b-393b-419b-8a83-4021b36f6dbc service nova] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:54:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-022a21b3-861e-4079-a222-70af42cdfa38 req-39a1cb6b-393b-419b-8a83-4021b36f6dbc service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:54:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-022a21b3-861e-4079-a222-70af42cdfa38 req-39a1cb6b-393b-419b-8a83-4021b36f6dbc service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:45 user nova-compute[71325]: DEBUG nova.compute.manager [req-022a21b3-861e-4079-a222-70af42cdfa38 req-39a1cb6b-393b-419b-8a83-4021b36f6dbc service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] No waiting events found dispatching network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:54:45 user nova-compute[71325]: WARNING nova.compute.manager [req-022a21b3-861e-4079-a222-70af42cdfa38 req-39a1cb6b-393b-419b-8a83-4021b36f6dbc service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received unexpected event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f for instance with vm_state active and task_state reboot_started.
Apr 13 21:54:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for 03554793-01dd-4629-97c7-b640f5934639 due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:54:45 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422885.895014, 03554793-01dd-4629-97c7-b640f5934639 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:54:45 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] VM Resumed (Lifecycle Event)
Apr 13 21:54:45 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 03554793-01dd-4629-97c7-b640f5934639] Instance running successfully.
Apr 13 21:54:45 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Instance soft rebooted successfully.
Apr 13 21:54:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:54:45 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 13 21:54:45 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422885.8968446, 03554793-01dd-4629-97c7-b640f5934639 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:54:45 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] VM Started (Lifecycle Event)
Apr 13 21:54:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "03554793-01dd-4629-97c7-b640f5934639" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.764s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:54:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:54:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:51 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422876.5288258, 2d1990a1-40ec-4c02-941f-813c22e8cd8f => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:54:51 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] VM Stopped (Lifecycle Event)
Apr 13 21:54:51 user nova-compute[71325]: DEBUG nova.compute.manager [None req-95f1f01f-d86d-4119-9df2-720a06b87deb None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:55 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422880.7916057, ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:54:55 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] VM Stopped (Lifecycle Event)
Apr 13 21:54:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-dd42443f-3148-4479-9ff6-f163b6ba727d None None] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:54:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:54:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:55:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:55:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:55:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:55:07 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:55:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:08 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Updating instance_info_cache with network_info: [{"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:55:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-68cb788e-be1f-44fc-b65e-b908a5831ae2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:55:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:55:08 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:55:08 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:55:08 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:55:09 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:55:09 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:55:09 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:55:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:09 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:55:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:11 user nova-compute[71325]: INFO nova.compute.manager [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Detaching volume 6c038cb0-7b1c-4305-97d8-318974560720
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:11 user nova-compute[71325]: INFO nova.virt.block_device [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Attempting to driver detach volume 6c038cb0-7b1c-4305-97d8-318974560720 from mountpoint /dev/vdb
Apr 13 21:55:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Attempting to detach device vdb from instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:55:11 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:55:11 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:55:11 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:55:11 user nova-compute[71325]:   <serial>6c038cb0-7b1c-4305-97d8-318974560720</serial>
Apr 13 21:55:11 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 21:55:11 user nova-compute[71325]: </disk>
Apr 13 21:55:11 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:55:11 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully detached device vdb from instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 from the persistent domain config.
Apr 13 21:55:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:55:11 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:55:11 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:55:11 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:55:11 user nova-compute[71325]:   <serial>6c038cb0-7b1c-4305-97d8-318974560720</serial>
Apr 13 21:55:11 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 21:55:11 user nova-compute[71325]: </disk>
Apr 13 21:55:11 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681422911.9338503, c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:55:11 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully detached device vdb from instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 from the live domain config.
Apr 13 21:55:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFsfLcoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:55:11 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:55:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8405cf2-831b-462c-906c-cff8080dd748]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:55:11 user nova-compute[71325]: No targets found.
Apr 13 21:55:11 user nova-compute[71325]: iSNS:
Apr 13 21:55:11 user nova-compute[71325]: No targets found.
Apr 13 21:55:11 user nova-compute[71325]: STATIC:
Apr 13 21:55:11 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720
Apr 13 21:55:11 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:55:11 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:55:11 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4
Apr 13 21:55:11 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:55:11 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:55:11 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:55:11 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:55:11 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:55:11 user nova-compute[71325]: FIRMWARE:
Apr 13 21:55:11 user nova-compute[71325]: No targets found.
Apr 13 21:55:11 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:55:11 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:55:11 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c124275-1202-4047-805b-14f7c159c51f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5629cc5-af17-4966-a5fd-f37028110f4d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:55:12 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:55:12 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:55:12 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:55:12 user nova-compute[71325]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 (non-flash)
Apr 13 21:55:12 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:55:12 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c42912d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720'): ({'sdc'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Removing single pathed devices sdc {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ad45a4-5261-4bd2-8b71-af7fcc9598b0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ac7cc6-f0f1-488c-b24b-781c0444559d]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flushing IO for device /dev/sdc {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce27626-4216-4ca4-b37a-1e9d11b4531e]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbda5fc-3965-4eeb-b43b-5e26c230194a]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef02a8b8-fcb9-48e8-adac-8e120679b44a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c0e05a-3ab3-44f5-b954-783ce45610bd]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260]
Apr 13 21:55:12 user nova-compute[71325]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720, portal: 172.16.0.220,3260] successful.
Apr 13 21:55:12 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c038cb0-7b1c-4305-97d8-318974560720 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9ac016-9a9c-4c75-87ca-fc6c292e61ee]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== disconnect_volume: return (363ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.objects.instance [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'flavor' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:13 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:55:13 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7577MB free_disk=26.138980865478516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.149s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 03554793-01dd-4629-97c7-b640f5934639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:55:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:55:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:55:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:55:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:55:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "64f496e7-47db-4602-850e-0260d5858049" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "64f496e7-47db-4602-850e-0260d5858049" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:16 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:55:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:16 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:55:16 user nova-compute[71325]: INFO nova.compute.claims [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Claim successful on node user
Apr 13 21:55:16 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:55:16 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:55:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:16 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:55:16 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:55:16 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:55:16 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:55:16 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:55:17 user nova-compute[71325]: INFO nova.virt.block_device [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Booting with volume snapshot 3b93cbae-1a6b-4c9c-9c82-e49108002327 at /dev/vda
Apr 13 21:55:17 user nova-compute[71325]: DEBUG nova.policy [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:55:17 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Successfully created port: 7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:55:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Successfully updated port: 7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:55:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "refresh_cache-64f496e7-47db-4602-850e-0260d5858049" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:55:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquired lock "refresh_cache-64f496e7-47db-4602-850e-0260d5858049" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:55:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:55:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:55:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-53ca99f8-850c-4602-b9b6-5f4c0965ae24 req-4de92a1f-f16d-4427-b99f-625024f4d548 service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] Received event network-changed-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-53ca99f8-850c-4602-b9b6-5f4c0965ae24 req-4de92a1f-f16d-4427-b99f-625024f4d548 service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] Refreshing instance network info cache due to event network-changed-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:55:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-53ca99f8-850c-4602-b9b6-5f4c0965ae24 req-4de92a1f-f16d-4427-b99f-625024f4d548 service nova] Acquiring lock "refresh_cache-64f496e7-47db-4602-850e-0260d5858049" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:55:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Updating instance_info_cache with network_info: [{"id": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "address": "fa:16:3e:0c:06:ae", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd2a5c6-f7", "ovs_interfaceid": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:55:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Releasing lock "refresh_cache-64f496e7-47db-4602-850e-0260d5858049" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:55:18 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Instance network_info: |[{"id": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "address": "fa:16:3e:0c:06:ae", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd2a5c6-f7", "ovs_interfaceid": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:55:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-53ca99f8-850c-4602-b9b6-5f4c0965ae24 req-4de92a1f-f16d-4427-b99f-625024f4d548 service nova] Acquired lock "refresh_cache-64f496e7-47db-4602-850e-0260d5858049" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:55:18 user nova-compute[71325]: DEBUG nova.network.neutron [req-53ca99f8-850c-4602-b9b6-5f4c0965ae24 req-4de92a1f-f16d-4427-b99f-625024f4d548 service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] Refreshing network info cache for port 7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:55:19 user nova-compute[71325]: DEBUG nova.network.neutron [req-53ca99f8-850c-4602-b9b6-5f4c0965ae24 req-4de92a1f-f16d-4427-b99f-625024f4d548 service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] Updated VIF entry in instance network info cache for port 7dd2a5c6-f76c-45f3-adf1-8e92fa15d479. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:55:19 user nova-compute[71325]: DEBUG nova.network.neutron [req-53ca99f8-850c-4602-b9b6-5f4c0965ae24 req-4de92a1f-f16d-4427-b99f-625024f4d548 service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] Updating instance_info_cache with network_info: [{"id": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "address": "fa:16:3e:0c:06:ae", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd2a5c6-f7", "ovs_interfaceid": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:55:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-53ca99f8-850c-4602-b9b6-5f4c0965ae24 req-4de92a1f-f16d-4427-b99f-625024f4d548 service nova] Releasing lock "refresh_cache-64f496e7-47db-4602-850e-0260d5858049" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:55:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG os_brick.utils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1268c5ae-7c94-49ac-aba1-5e4e9d1decbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b98c375-e8e8-4a2e-9946-5e268e497d36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b37366-6a80-452c-a1b8-bd3bb7f3280e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f03b6f-0fae-42f0-89b2-fbffcec71831]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:55:22 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:55:22 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[09742b09-4421-4e6b-9724-a0995b0f850f]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG os_brick.utils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:55:22 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Updating existing volume attachment record: 9df05d3b-f2f1-4522-a18c-e750ce0bb663 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:55:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:55:27 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Creating image(s)
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Ensure instance console log exists: /opt/stack/data/nova/instances/64f496e7-47db-4602-850e-0260d5858049/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Start _get_guest_xml network_info=[{"id": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "address": "fa:16:3e:0c:06:ae", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd2a5c6-f7", "ovs_interfaceid": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRmrYWQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64f496e7-47db-4602-850e-0260d5858049', 'attached_at': '', 'detached_at': '', 'volume_id': '2c71ae3e-d70a-4cb3-b997-8270a4b05b41', 'serial': '2c71ae3e-d70a-4cb3-b997-8270a4b05b41'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '9df05d3b-f2f1-4522-a18c-e750ce0bb663', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:55:27 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:55:27 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRmrYWQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:55:27 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:55:27 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:55:27 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260" returned: 21 in 0.037s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2125dee7-a87b-40b1-9aa1-c78996c2cdb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:55:27 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfe9077-5225-424d-8311-9ccaad8dc8f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41] added
Apr 13 21:55:27 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdef2cc-c3ce-46a0-a3fe-ead440519aeb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2dd23d-8d73-4f20-b372-5a8de97a53dd]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRmrYWQF {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRmrYWQF" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e54f1e-b5a3-4424-83fc-2c73ec63fbe9]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eRmrYWQF'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de2adae-b6f3-478a-86ef-fa5631d572b6]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ec418b-a059-4453-8121-3c39e5d739dc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:55:27 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:55:27 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:55:27 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:55:27 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[452998f1-5ec0-44b9-9ea8-14569addb008]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41, portal: 172.16.0.220,3260]
Apr 13 21:55:27 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41, portal: 172.16.0.220,3260] successful.
Apr 13 21:55:27 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[34729492-3d14-4daa-823f-54b0689bee9d]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[51723708-a5b0-4a7e-b676-495eb31f3dbe]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:55:27 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:55:27 user nova-compute[71325]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)
Apr 13 21:55:27 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:55:27 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:55:27 user nova-compute[71325]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)
Apr 13 21:55:27 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6202a9d-a165-419a-86f3-abf565c696bd]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:55:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRmrYWQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23663303061356563', 'path': '/dev/sdc'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663303061356563', 'path': '/dev/sdc'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1202537126',display_name='tempest-TestVolumeBootPattern-server-1202537126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1202537126',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-5dhza4ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:55:17Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=64f496e7-47db-4602-850e-0260d5858049,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "address": "fa:16:3e:0c:06:ae", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd2a5c6-f7", "ovs_interfaceid": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "address": "fa:16:3e:0c:06:ae", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd2a5c6-f7", "ovs_interfaceid": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:ae,bridge_name='br-int',has_traffic_filtering=True,id=7dd2a5c6-f76c-45f3-adf1-8e92fa15d479,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd2a5c6-f7') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lazy-loading 'pci_devices' on Instance uuid 64f496e7-47db-4602-850e-0260d5858049 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:55:28 user nova-compute[71325]:   <uuid>64f496e7-47db-4602-850e-0260d5858049</uuid>
Apr 13 21:55:28 user nova-compute[71325]:   <name>instance-00000019</name>
Apr 13 21:55:28 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:55:28 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:55:28 user nova-compute[71325]:   <metadata>
Apr 13 21:55:28 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:55:28 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:55:28 user nova-compute[71325]:       <nova:name>tempest-TestVolumeBootPattern-server-1202537126</nova:name>
Apr 13 21:55:28 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:55:27</nova:creationTime>
Apr 13 21:55:28 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:55:28 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:55:28 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:55:28 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:55:28 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:55:28 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:55:28 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:55:28 user nova-compute[71325]:       <nova:owner>
Apr 13 21:55:28 user nova-compute[71325]:         <nova:user uuid="50a8a5f433c94e0c9ba4d6ecea37d756">tempest-TestVolumeBootPattern-1335483698-project-member</nova:user>
Apr 13 21:55:28 user nova-compute[71325]:         <nova:project uuid="ad824150d99044c6ab1c7829cbe01de5">tempest-TestVolumeBootPattern-1335483698</nova:project>
Apr 13 21:55:28 user nova-compute[71325]:       </nova:owner>
Apr 13 21:55:28 user nova-compute[71325]:       <nova:ports>
Apr 13 21:55:28 user nova-compute[71325]:         <nova:port uuid="7dd2a5c6-f76c-45f3-adf1-8e92fa15d479">
Apr 13 21:55:28 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 21:55:28 user nova-compute[71325]:         </nova:port>
Apr 13 21:55:28 user nova-compute[71325]:       </nova:ports>
Apr 13 21:55:28 user nova-compute[71325]:     </nova:instance>
Apr 13 21:55:28 user nova-compute[71325]:   </metadata>
Apr 13 21:55:28 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:55:28 user nova-compute[71325]:     <system>
Apr 13 21:55:28 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:55:28 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:55:28 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:55:28 user nova-compute[71325]:       <entry name="serial">64f496e7-47db-4602-850e-0260d5858049</entry>
Apr 13 21:55:28 user nova-compute[71325]:       <entry name="uuid">64f496e7-47db-4602-850e-0260d5858049</entry>
Apr 13 21:55:28 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:55:28 user nova-compute[71325]:     </system>
Apr 13 21:55:28 user nova-compute[71325]:   </sysinfo>
Apr 13 21:55:28 user nova-compute[71325]:   <os>
Apr 13 21:55:28 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:55:28 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:55:28 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:55:28 user nova-compute[71325]:   </os>
Apr 13 21:55:28 user nova-compute[71325]:   <features>
Apr 13 21:55:28 user nova-compute[71325]:     <acpi/>
Apr 13 21:55:28 user nova-compute[71325]:     <apic/>
Apr 13 21:55:28 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:55:28 user nova-compute[71325]:   </features>
Apr 13 21:55:28 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:55:28 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:55:28 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:55:28 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:55:28 user nova-compute[71325]:   </clock>
Apr 13 21:55:28 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:55:28 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:55:28 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:55:28 user nova-compute[71325]:   </cpu>
Apr 13 21:55:28 user nova-compute[71325]:   <devices>
Apr 13 21:55:28 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:55:28 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:55:28 user nova-compute[71325]:       <source dev="/dev/sdc"/>
Apr 13 21:55:28 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:55:28 user nova-compute[71325]:       <serial>2c71ae3e-d70a-4cb3-b997-8270a4b05b41</serial>
Apr 13 21:55:28 user nova-compute[71325]:     </disk>
Apr 13 21:55:28 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:55:28 user nova-compute[71325]:       <mac address="fa:16:3e:0c:06:ae"/>
Apr 13 21:55:28 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:55:28 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:55:28 user nova-compute[71325]:       <target dev="tap7dd2a5c6-f7"/>
Apr 13 21:55:28 user nova-compute[71325]:     </interface>
Apr 13 21:55:28 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:55:28 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/64f496e7-47db-4602-850e-0260d5858049/console.log" append="off"/>
Apr 13 21:55:28 user nova-compute[71325]:     </serial>
Apr 13 21:55:28 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:55:28 user nova-compute[71325]:     <video>
Apr 13 21:55:28 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:55:28 user nova-compute[71325]:     </video>
Apr 13 21:55:28 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:55:28 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:55:28 user nova-compute[71325]:     </rng>
Apr 13 21:55:28 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:55:28 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:55:28 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:55:28 user nova-compute[71325]:     </memballoon>
Apr 13 21:55:28 user nova-compute[71325]:   </devices>
Apr 13 21:55:28 user nova-compute[71325]: </domain>
Apr 13 21:55:28 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1202537126',display_name='tempest-TestVolumeBootPattern-server-1202537126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1202537126',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-5dhza4ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:55:17Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=64f496e7-47db-4602-850e-0260d5858049,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "address": "fa:16:3e:0c:06:ae", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd2a5c6-f7", "ovs_interfaceid": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "address": "fa:16:3e:0c:06:ae", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd2a5c6-f7", "ovs_interfaceid": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:ae,bridge_name='br-int',has_traffic_filtering=True,id=7dd2a5c6-f76c-45f3-adf1-8e92fa15d479,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd2a5c6-f7') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG os_vif [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:ae,bridge_name='br-int',has_traffic_filtering=True,id=7dd2a5c6-f76c-45f3-adf1-8e92fa15d479,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd2a5c6-f7') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7dd2a5c6-f7, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7dd2a5c6-f7, col_values=(('external_ids', {'iface-id': '7dd2a5c6-f76c-45f3-adf1-8e92fa15d479', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:06:ae', 'vm-uuid': '64f496e7-47db-4602-850e-0260d5858049'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:55:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:28 user nova-compute[71325]: INFO os_vif [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:ae,bridge_name='br-int',has_traffic_filtering=True,id=7dd2a5c6-f76c-45f3-adf1-8e92fa15d479,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd2a5c6-f7')
Apr 13 21:55:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:55:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] No VIF found with MAC fa:16:3e:0c:06:ae, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:55:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG nova.compute.manager [req-3a23f109-4c12-45ef-9bdf-6dc055101ce4 req-09184277-52f1-49b4-b4b1-41e46237b2a4 service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Received event network-changed-1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG nova.compute.manager [req-3a23f109-4c12-45ef-9bdf-6dc055101ce4 req-09184277-52f1-49b4-b4b1-41e46237b2a4 service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Refreshing instance network info cache due to event network-changed-1d9d691f-bf56-4916-9d1d-422be2299247. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3a23f109-4c12-45ef-9bdf-6dc055101ce4 req-09184277-52f1-49b4-b4b1-41e46237b2a4 service nova] Acquiring lock "refresh_cache-78b584a2-7dbc-4793-9d93-37897f9a24b1" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3a23f109-4c12-45ef-9bdf-6dc055101ce4 req-09184277-52f1-49b4-b4b1-41e46237b2a4 service nova] Acquired lock "refresh_cache-78b584a2-7dbc-4793-9d93-37897f9a24b1" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG nova.network.neutron [req-3a23f109-4c12-45ef-9bdf-6dc055101ce4 req-09184277-52f1-49b4-b4b1-41e46237b2a4 service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Refreshing network info cache for port 1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG nova.compute.manager [req-671d4c2b-b98a-4571-a60f-22c9f4cbfa75 req-f610b41a-c600-467e-81d5-51ca19d311e4 service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] Received event network-vif-plugged-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-671d4c2b-b98a-4571-a60f-22c9f4cbfa75 req-f610b41a-c600-467e-81d5-51ca19d311e4 service nova] Acquiring lock "64f496e7-47db-4602-850e-0260d5858049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-671d4c2b-b98a-4571-a60f-22c9f4cbfa75 req-f610b41a-c600-467e-81d5-51ca19d311e4 service nova] Lock "64f496e7-47db-4602-850e-0260d5858049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-671d4c2b-b98a-4571-a60f-22c9f4cbfa75 req-f610b41a-c600-467e-81d5-51ca19d311e4 service nova] Lock "64f496e7-47db-4602-850e-0260d5858049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG nova.compute.manager [req-671d4c2b-b98a-4571-a60f-22c9f4cbfa75 req-f610b41a-c600-467e-81d5-51ca19d311e4 service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] No waiting events found dispatching network-vif-plugged-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:55:30 user nova-compute[71325]: WARNING nova.compute.manager [req-671d4c2b-b98a-4571-a60f-22c9f4cbfa75 req-f610b41a-c600-467e-81d5-51ca19d311e4 service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] Received unexpected event network-vif-plugged-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 for instance with vm_state building and task_state spawning.
Apr 13 21:55:30 user nova-compute[71325]: DEBUG nova.network.neutron [req-3a23f109-4c12-45ef-9bdf-6dc055101ce4 req-09184277-52f1-49b4-b4b1-41e46237b2a4 service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Updated VIF entry in instance network info cache for port 1d9d691f-bf56-4916-9d1d-422be2299247. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG nova.network.neutron [req-3a23f109-4c12-45ef-9bdf-6dc055101ce4 req-09184277-52f1-49b4-b4b1-41e46237b2a4 service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Updating instance_info_cache with network_info: [{"id": "1d9d691f-bf56-4916-9d1d-422be2299247", "address": "fa:16:3e:54:e6:ae", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d9d691f-bf", "ovs_interfaceid": "1d9d691f-bf56-4916-9d1d-422be2299247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3a23f109-4c12-45ef-9bdf-6dc055101ce4 req-09184277-52f1-49b4-b4b1-41e46237b2a4 service nova] Releasing lock "refresh_cache-78b584a2-7dbc-4793-9d93-37897f9a24b1" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-9d0339bb-6307-49e8-8c18-ce38797fbec0 req-4ec9578d-d7d8-4821-ac56-530d6db09fec service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] Received event network-vif-plugged-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9d0339bb-6307-49e8-8c18-ce38797fbec0 req-4ec9578d-d7d8-4821-ac56-530d6db09fec service nova] Acquiring lock "64f496e7-47db-4602-850e-0260d5858049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9d0339bb-6307-49e8-8c18-ce38797fbec0 req-4ec9578d-d7d8-4821-ac56-530d6db09fec service nova] Lock "64f496e7-47db-4602-850e-0260d5858049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9d0339bb-6307-49e8-8c18-ce38797fbec0 req-4ec9578d-d7d8-4821-ac56-530d6db09fec service nova] Lock "64f496e7-47db-4602-850e-0260d5858049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-9d0339bb-6307-49e8-8c18-ce38797fbec0 req-4ec9578d-d7d8-4821-ac56-530d6db09fec service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] No waiting events found dispatching network-vif-plugged-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:55:32 user nova-compute[71325]: WARNING nova.compute.manager [req-9d0339bb-6307-49e8-8c18-ce38797fbec0 req-4ec9578d-d7d8-4821-ac56-530d6db09fec service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] Received unexpected event network-vif-plugged-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 for instance with vm_state building and task_state spawning.
Apr 13 21:55:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422932.8147998, 64f496e7-47db-4602-850e-0260d5858049 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:55:32 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 64f496e7-47db-4602-850e-0260d5858049] VM Resumed (Lifecycle Event)
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.objects.instance [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'flavor' on Instance uuid 78b584a2-7dbc-4793-9d93-37897f9a24b1 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 64f496e7-47db-4602-850e-0260d5858049] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:32 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 64f496e7-47db-4602-850e-0260d5858049] Instance spawned successfully.
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 64f496e7-47db-4602-850e-0260d5858049] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:32 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 64f496e7-47db-4602-850e-0260d5858049] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422932.8197064, 64f496e7-47db-4602-850e-0260d5858049 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:55:32 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 64f496e7-47db-4602-850e-0260d5858049] VM Started (Lifecycle Event)
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 64f496e7-47db-4602-850e-0260d5858049] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 64f496e7-47db-4602-850e-0260d5858049] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:55:32 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 64f496e7-47db-4602-850e-0260d5858049] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:55:33 user nova-compute[71325]: INFO nova.compute.manager [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Took 5.49 seconds to spawn the instance on the hypervisor.
Apr 13 21:55:33 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:33 user nova-compute[71325]: INFO nova.compute.manager [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Took 16.63 seconds to build instance.
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:33 user nova-compute[71325]: INFO nova.compute.manager [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Attaching volume 314899e4-f6f0-4aba-a3cb-60eca54e6808 to /dev/vdb
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "64f496e7-47db-4602-850e-0260d5858049" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.732s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG nova.objects.instance [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'flavor' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG os_brick.utils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeadaa6d-c7be-47f0-a5ae-8102e27cccc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaf602a-3427-4046-84b9-9a28c9861d53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c97f47-858b-4ffb-9e73-7e44d31ad369]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd95a82a-075e-4dd6-aaf1-4df1057df9cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:55:33 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5ef2db-f24d-4e52-9177-c607f240dd0c]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG os_brick.utils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Updating existing volume attachment record: e85d211f-63b2-4cab-96c3-e10b2b799471 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:33 user nova-compute[71325]: INFO nova.compute.manager [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Attaching volume 0a3bb043-64a5-42ac-afa3-e4f0896f84d4 to /dev/vdb
Apr 13 21:55:33 user nova-compute[71325]: DEBUG os_brick.utils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db1bd56-f844-406c-8039-a96044288482]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb090bf5-63f6-4fc7-973c-dacc18fdb473]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba1415b-52c5-4c16-98a6-df2cda26ea0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[34359746-7ace-4db1-a378-2e2c06c3692d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:55:33 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:55:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad100436-cde8-444c-a450-012643f567ff]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG os_brick.utils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Updating existing volume attachment record: cbdbc997-6c14-4d30-b27c-6bfd3b76b7ad {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:55:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-1781d903-f617-4071-9888-46f2574cc63e req-7456cd97-80dd-452a-957b-b8c2951a7408 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-changed-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-1781d903-f617-4071-9888-46f2574cc63e req-7456cd97-80dd-452a-957b-b8c2951a7408 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Refreshing instance network info cache due to event network-changed-a438af72-b7ff-4ab6-82f5-59cf460c430f. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:55:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1781d903-f617-4071-9888-46f2574cc63e req-7456cd97-80dd-452a-957b-b8c2951a7408 service nova] Acquiring lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:55:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1781d903-f617-4071-9888-46f2574cc63e req-7456cd97-80dd-452a-957b-b8c2951a7408 service nova] Acquired lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:55:34 user nova-compute[71325]: DEBUG nova.network.neutron [req-1781d903-f617-4071-9888-46f2574cc63e req-7456cd97-80dd-452a-957b-b8c2951a7408 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Refreshing network info cache for port a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:55:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:55:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:35 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:55:35 user nova-compute[71325]: INFO nova.compute.claims [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Claim successful on node user
Apr 13 21:55:35 user nova-compute[71325]: DEBUG nova.network.neutron [req-1781d903-f617-4071-9888-46f2574cc63e req-7456cd97-80dd-452a-957b-b8c2951a7408 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Updated VIF entry in instance network info cache for port a438af72-b7ff-4ab6-82f5-59cf460c430f. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:55:35 user nova-compute[71325]: DEBUG nova.network.neutron [req-1781d903-f617-4071-9888-46f2574cc63e req-7456cd97-80dd-452a-957b-b8c2951a7408 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Updating instance_info_cache with network_info: [{"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:55:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1781d903-f617-4071-9888-46f2574cc63e req-7456cd97-80dd-452a-957b-b8c2951a7408 service nova] Releasing lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:55:35 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:55:35 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:55:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:55:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:55:35 user nova-compute[71325]: DEBUG nova.network.neutron [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:55:35 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:55:36 user nova-compute[71325]: DEBUG nova.compute.manager [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG nova.policy [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG nova.compute.manager [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:55:36 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Creating image(s)
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "/opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "/opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "/opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.183s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk 1073741824" returned: 0 in 0.056s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.193s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG nova.network.neutron [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Successfully created port: 281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Cannot resize image /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG nova.objects.instance [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'migration_context' on Instance uuid 68dbaff0-73ca-4caa-bd4f-f97065df4409 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Ensure instance console log exists: /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:37 user nova-compute[71325]: DEBUG nova.network.neutron [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Successfully updated port: 281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:55:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "refresh_cache-68dbaff0-73ca-4caa-bd4f-f97065df4409" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:55:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquired lock "refresh_cache-68dbaff0-73ca-4caa-bd4f-f97065df4409" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:55:37 user nova-compute[71325]: DEBUG nova.network.neutron [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:55:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-6317062e-631f-45f0-a1e2-e42ff8f9c254 req-21205e74-fca1-404a-8525-7ec2bb1a0c1b service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Received event network-changed-281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-6317062e-631f-45f0-a1e2-e42ff8f9c254 req-21205e74-fca1-404a-8525-7ec2bb1a0c1b service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Refreshing instance network info cache due to event network-changed-281f102d-de13-4548-a18c-3e452509c97c. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:55:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6317062e-631f-45f0-a1e2-e42ff8f9c254 req-21205e74-fca1-404a-8525-7ec2bb1a0c1b service nova] Acquiring lock "refresh_cache-68dbaff0-73ca-4caa-bd4f-f97065df4409" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:55:37 user nova-compute[71325]: DEBUG nova.network.neutron [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Updating instance_info_cache with network_info: [{"id": "281f102d-de13-4548-a18c-3e452509c97c", "address": "fa:16:3e:8d:19:2f", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281f102d-de", "ovs_interfaceid": "281f102d-de13-4548-a18c-3e452509c97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Releasing lock "refresh_cache-68dbaff0-73ca-4caa-bd4f-f97065df4409" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Instance network_info: |[{"id": "281f102d-de13-4548-a18c-3e452509c97c", "address": "fa:16:3e:8d:19:2f", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281f102d-de", "ovs_interfaceid": "281f102d-de13-4548-a18c-3e452509c97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6317062e-631f-45f0-a1e2-e42ff8f9c254 req-21205e74-fca1-404a-8525-7ec2bb1a0c1b service nova] Acquired lock "refresh_cache-68dbaff0-73ca-4caa-bd4f-f97065df4409" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.network.neutron [req-6317062e-631f-45f0-a1e2-e42ff8f9c254 req-21205e74-fca1-404a-8525-7ec2bb1a0c1b service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Refreshing network info cache for port 281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Start _get_guest_xml network_info=[{"id": "281f102d-de13-4548-a18c-3e452509c97c", "address": "fa:16:3e:8d:19:2f", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281f102d-de", "ovs_interfaceid": "281f102d-de13-4548-a18c-3e452509c97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:55:38 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:55:38 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1947981713',display_name='tempest-AttachVolumeTestJSON-server-1947981713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1947981713',id=26,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGsNbk24v9gRwINKBHxnvwkpynX5ApVk07JfuyA5Y8CkVYfwSmGLiy3Yb85Bd5j3v3egJvdO0SGKRzUdcKUmZwBQQD/pQ4Siu2lstEO6sNPuVcdj1xLfaPETf+n2/dHlw==',key_name='tempest-keypair-1585186331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3605d609b52b431993bcea0798a77554',ramdisk_id='',reservation_id='r-34oke2up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-249879422',owner_user_name='tempest-AttachVolumeTestJSON-249879422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:55:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60e4dadf9d9e41e6a91ee03a0cd50dc3',uuid=68dbaff0-73ca-4caa-bd4f-f97065df4409,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "281f102d-de13-4548-a18c-3e452509c97c", "address": "fa:16:3e:8d:19:2f", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281f102d-de", "ovs_interfaceid": "281f102d-de13-4548-a18c-3e452509c97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converting VIF {"id": "281f102d-de13-4548-a18c-3e452509c97c", "address": "fa:16:3e:8d:19:2f", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281f102d-de", "ovs_interfaceid": "281f102d-de13-4548-a18c-3e452509c97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:2f,bridge_name='br-int',has_traffic_filtering=True,id=281f102d-de13-4548-a18c-3e452509c97c,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281f102d-de') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.objects.instance [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'pci_devices' on Instance uuid 68dbaff0-73ca-4caa-bd4f-f97065df4409 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:55:38 user nova-compute[71325]:   <uuid>68dbaff0-73ca-4caa-bd4f-f97065df4409</uuid>
Apr 13 21:55:38 user nova-compute[71325]:   <name>instance-0000001a</name>
Apr 13 21:55:38 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:55:38 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:55:38 user nova-compute[71325]:   <metadata>
Apr 13 21:55:38 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:55:38 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:55:38 user nova-compute[71325]:       <nova:name>tempest-AttachVolumeTestJSON-server-1947981713</nova:name>
Apr 13 21:55:38 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:55:38</nova:creationTime>
Apr 13 21:55:38 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:55:38 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:55:38 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:55:38 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:55:38 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:55:38 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:55:38 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:55:38 user nova-compute[71325]:       <nova:owner>
Apr 13 21:55:38 user nova-compute[71325]:         <nova:user uuid="60e4dadf9d9e41e6a91ee03a0cd50dc3">tempest-AttachVolumeTestJSON-249879422-project-member</nova:user>
Apr 13 21:55:38 user nova-compute[71325]:         <nova:project uuid="3605d609b52b431993bcea0798a77554">tempest-AttachVolumeTestJSON-249879422</nova:project>
Apr 13 21:55:38 user nova-compute[71325]:       </nova:owner>
Apr 13 21:55:38 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:55:38 user nova-compute[71325]:       <nova:ports>
Apr 13 21:55:38 user nova-compute[71325]:         <nova:port uuid="281f102d-de13-4548-a18c-3e452509c97c">
Apr 13 21:55:38 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 21:55:38 user nova-compute[71325]:         </nova:port>
Apr 13 21:55:38 user nova-compute[71325]:       </nova:ports>
Apr 13 21:55:38 user nova-compute[71325]:     </nova:instance>
Apr 13 21:55:38 user nova-compute[71325]:   </metadata>
Apr 13 21:55:38 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:55:38 user nova-compute[71325]:     <system>
Apr 13 21:55:38 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:55:38 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:55:38 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:55:38 user nova-compute[71325]:       <entry name="serial">68dbaff0-73ca-4caa-bd4f-f97065df4409</entry>
Apr 13 21:55:38 user nova-compute[71325]:       <entry name="uuid">68dbaff0-73ca-4caa-bd4f-f97065df4409</entry>
Apr 13 21:55:38 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:55:38 user nova-compute[71325]:     </system>
Apr 13 21:55:38 user nova-compute[71325]:   </sysinfo>
Apr 13 21:55:38 user nova-compute[71325]:   <os>
Apr 13 21:55:38 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:55:38 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:55:38 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:55:38 user nova-compute[71325]:   </os>
Apr 13 21:55:38 user nova-compute[71325]:   <features>
Apr 13 21:55:38 user nova-compute[71325]:     <acpi/>
Apr 13 21:55:38 user nova-compute[71325]:     <apic/>
Apr 13 21:55:38 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:55:38 user nova-compute[71325]:   </features>
Apr 13 21:55:38 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:55:38 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:55:38 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:55:38 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:55:38 user nova-compute[71325]:   </clock>
Apr 13 21:55:38 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:55:38 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:55:38 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:55:38 user nova-compute[71325]:   </cpu>
Apr 13 21:55:38 user nova-compute[71325]:   <devices>
Apr 13 21:55:38 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:55:38 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:55:38 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk"/>
Apr 13 21:55:38 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:55:38 user nova-compute[71325]:     </disk>
Apr 13 21:55:38 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:55:38 user nova-compute[71325]:       <mac address="fa:16:3e:8d:19:2f"/>
Apr 13 21:55:38 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:55:38 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:55:38 user nova-compute[71325]:       <target dev="tap281f102d-de"/>
Apr 13 21:55:38 user nova-compute[71325]:     </interface>
Apr 13 21:55:38 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:55:38 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/console.log" append="off"/>
Apr 13 21:55:38 user nova-compute[71325]:     </serial>
Apr 13 21:55:38 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:55:38 user nova-compute[71325]:     <video>
Apr 13 21:55:38 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:55:38 user nova-compute[71325]:     </video>
Apr 13 21:55:38 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:55:38 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:55:38 user nova-compute[71325]:     </rng>
Apr 13 21:55:38 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:55:38 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:55:38 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:55:38 user nova-compute[71325]:     </memballoon>
Apr 13 21:55:38 user nova-compute[71325]:   </devices>
Apr 13 21:55:38 user nova-compute[71325]: </domain>
Apr 13 21:55:38 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1947981713',display_name='tempest-AttachVolumeTestJSON-server-1947981713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1947981713',id=26,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGsNbk24v9gRwINKBHxnvwkpynX5ApVk07JfuyA5Y8CkVYfwSmGLiy3Yb85Bd5j3v3egJvdO0SGKRzUdcKUmZwBQQD/pQ4Siu2lstEO6sNPuVcdj1xLfaPETf+n2/dHlw==',key_name='tempest-keypair-1585186331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3605d609b52b431993bcea0798a77554',ramdisk_id='',reservation_id='r-34oke2up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-249879422',owner_user_name='tempest-AttachVolumeTestJSON-249879422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:55:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60e4dadf9d9e41e6a91ee03a0cd50dc3',uuid=68dbaff0-73ca-4caa-bd4f-f97065df4409,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "281f102d-de13-4548-a18c-3e452509c97c", "address": "fa:16:3e:8d:19:2f", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281f102d-de", "ovs_interfaceid": "281f102d-de13-4548-a18c-3e452509c97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converting VIF {"id": "281f102d-de13-4548-a18c-3e452509c97c", "address": "fa:16:3e:8d:19:2f", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281f102d-de", "ovs_interfaceid": "281f102d-de13-4548-a18c-3e452509c97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:2f,bridge_name='br-int',has_traffic_filtering=True,id=281f102d-de13-4548-a18c-3e452509c97c,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281f102d-de') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_vif [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:2f,bridge_name='br-int',has_traffic_filtering=True,id=281f102d-de13-4548-a18c-3e452509c97c,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281f102d-de') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap281f102d-de, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap281f102d-de, col_values=(('external_ids', {'iface-id': '281f102d-de13-4548-a18c-3e452509c97c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:19:2f', 'vm-uuid': '68dbaff0-73ca-4caa-bd4f-f97065df4409'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:38 user nova-compute[71325]: INFO os_vif [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:2f,bridge_name='br-int',has_traffic_filtering=True,id=281f102d-de13-4548-a18c-3e452509c97c,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281f102d-de')
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKhDWRlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:55:38 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:55:38 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:55:38 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2df4925-f3c5-41f0-b197-b69f8854fd0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:55:38 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] No VIF found with MAC fa:16:3e:8d:19:2f, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[008e68ae-8a10-47f3-b8be-b13356d744dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808] added
Apr 13 21:55:38 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b133bc30-923c-4115-b4bf-620be22bff95]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1831d2db-27e4-47b0-bad5-1b0c30f06f06]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fYRZoaFM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:55:38 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKhDWRlX {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKhDWRlX" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[44800572-cf88-4cc6-98f2-7645904a0d2c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TKhDWRlX'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[081eac16-8dd4-4ac7-aa03-9b44bba28b08]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3621d823-0e5f-4d8f-bf62-d9760767319d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:55:38 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:55:38 user nova-compute[71325]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)
Apr 13 21:55:38 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:55:38 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:55:38 user nova-compute[71325]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)
Apr 13 21:55:38 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1c96ca-fd0c-44a6-aa46-45ffb0f56a9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808, portal: 172.16.0.220,3260]
Apr 13 21:55:38 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808, portal: 172.16.0.220,3260] successful.
Apr 13 21:55:38 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[915eeeab-0e30-44ab-ad92-a63963b6d987]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa20ccb9-6b6e-4ab9-b266-e9c708eb9298]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:55:38 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:55:38 user nova-compute[71325]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)
Apr 13 21:55:38 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:55:38 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:55:38 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:55:38 user nova-compute[71325]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)
Apr 13 21:55:38 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:55:38 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed763508-e2e3-4d21-8924-0b48ebd9cadd]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKhDWRlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.network.neutron [req-6317062e-631f-45f0-a1e2-e42ff8f9c254 req-21205e74-fca1-404a-8525-7ec2bb1a0c1b service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Updated VIF entry in instance network info cache for port 281f102d-de13-4548-a18c-3e452509c97c. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG nova.network.neutron [req-6317062e-631f-45f0-a1e2-e42ff8f9c254 req-21205e74-fca1-404a-8525-7ec2bb1a0c1b service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Updating instance_info_cache with network_info: [{"id": "281f102d-de13-4548-a18c-3e452509c97c", "address": "fa:16:3e:8d:19:2f", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281f102d-de", "ovs_interfaceid": "281f102d-de13-4548-a18c-3e452509c97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:55:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6317062e-631f-45f0-a1e2-e42ff8f9c254 req-21205e74-fca1-404a-8525-7ec2bb1a0c1b service nova] Releasing lock "refresh_cache-68dbaff0-73ca-4caa-bd4f-f97065df4409" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26632643565336561', 'path': '/dev/sde'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632643565336561', 'path': '/dev/sde'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.234s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:55:39 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:55:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:55:39 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG nova.objects.instance [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'flavor' on Instance uuid 78b584a2-7dbc-4793-9d93-37897f9a24b1 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[143572f9-a8ba-4220-a4c3-dc0c05e254d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:55:39 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:55:39 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:55:39 user nova-compute[71325]:   <source dev="/dev/sde"/>
Apr 13 21:55:39 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:55:39 user nova-compute[71325]:   <serial>314899e4-f6f0-4aba-a3cb-60eca54e6808</serial>
Apr 13 21:55:39 user nova-compute[71325]: </disk>
Apr 13 21:55:39 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[934a6c7b-cffb-47e1-95c5-0a02962b5ad2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4] added
Apr 13 21:55:39 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaf8a61-dfec-4314-9659-68e2cf0cd8f5]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a8511f-60c2-4ff1-bb9d-0cef5136f8f2]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fYRZoaFM {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fYRZoaFM" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5c774c-5f90-4089-b96c-81a09dfd2d17]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fYRZoaFM'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9835cee3-5ca9-4b48-b9bb-f56dfb24cf06]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0ad16c-ae5c-4ace-a441-7caa7404dfae]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:55:39 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:55:39 user nova-compute[71325]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)
Apr 13 21:55:39 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:55:39 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:55:39 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:55:39 user nova-compute[71325]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)
Apr 13 21:55:39 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:55:39 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-fb1ed845-04f6-469c-97dc-ab4b215cf76b req-11911870-a18c-4cb9-b2fa-d7c5e151a2a4 service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Received event network-vif-plugged-281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-fb1ed845-04f6-469c-97dc-ab4b215cf76b req-11911870-a18c-4cb9-b2fa-d7c5e151a2a4 service nova] Acquiring lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-fb1ed845-04f6-469c-97dc-ab4b215cf76b req-11911870-a18c-4cb9-b2fa-d7c5e151a2a4 service nova] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-fb1ed845-04f6-469c-97dc-ab4b215cf76b req-11911870-a18c-4cb9-b2fa-d7c5e151a2a4 service nova] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-fb1ed845-04f6-469c-97dc-ab4b215cf76b req-11911870-a18c-4cb9-b2fa-d7c5e151a2a4 service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] No waiting events found dispatching network-vif-plugged-281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:55:39 user nova-compute[71325]: WARNING nova.compute.manager [req-fb1ed845-04f6-469c-97dc-ab4b215cf76b req-11911870-a18c-4cb9-b2fa-d7c5e151a2a4 service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Received unexpected event network-vif-plugged-281f102d-de13-4548-a18c-3e452509c97c for instance with vm_state building and task_state spawning.
Apr 13 21:55:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.174s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2cc26c-b47f-4eff-b408-7d952beb8ce3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4, portal: 172.16.0.220,3260]
Apr 13 21:55:40 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4, portal: 172.16.0.220,3260] successful.
Apr 13 21:55:40 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0894a1f5-a4de-48ab-8914-426461c45200]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca335fd1-a9d3-440f-8e24-e90d307f621d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:55:40 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:55:40 user nova-compute[71325]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)
Apr 13 21:55:40 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:55:40 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:55:40 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:55:40 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:55:40 user nova-compute[71325]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)
Apr 13 21:55:40 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:55:40 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:55:40 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa25041-1cb4-45b3-b42b-9dc8614b82f9]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fYRZoaFM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No VIF found with MAC fa:16:3e:54:e6:ae, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:55:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.444s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:55:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] <== connect_volume: return (2706ms) {'type': 'block', 'scsi_wwn': '23438376336396237', 'path': '/dev/sdf'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:55:41 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438376336396237', 'path': '/dev/sdf'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:55:41 user nova-compute[71325]: DEBUG nova.objects.instance [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'flavor' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:41 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:55:41 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:55:41 user nova-compute[71325]:   <source dev="/dev/sdf"/>
Apr 13 21:55:41 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:55:41 user nova-compute[71325]:   <serial>0a3bb043-64a5-42ac-afa3-e4f0896f84d4</serial>
Apr 13 21:55:41 user nova-compute[71325]: </disk>
Apr 13 21:55:41 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:55:41 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:55:41 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:55:41 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No VIF found with MAC fa:16:3e:79:ad:c6, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:55:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.211s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-7e7524e2-494f-403c-b720-9b4a45617211 req-43da7985-031c-4c17-a374-0da2e2b92017 service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Received event network-vif-plugged-281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7e7524e2-494f-403c-b720-9b4a45617211 req-43da7985-031c-4c17-a374-0da2e2b92017 service nova] Acquiring lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7e7524e2-494f-403c-b720-9b4a45617211 req-43da7985-031c-4c17-a374-0da2e2b92017 service nova] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7e7524e2-494f-403c-b720-9b4a45617211 req-43da7985-031c-4c17-a374-0da2e2b92017 service nova] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-7e7524e2-494f-403c-b720-9b4a45617211 req-43da7985-031c-4c17-a374-0da2e2b92017 service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] No waiting events found dispatching network-vif-plugged-281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:55:42 user nova-compute[71325]: WARNING nova.compute.manager [req-7e7524e2-494f-403c-b720-9b4a45617211 req-43da7985-031c-4c17-a374-0da2e2b92017 service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Received unexpected event network-vif-plugged-281f102d-de13-4548-a18c-3e452509c97c for instance with vm_state building and task_state spawning.
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422942.206909, 68dbaff0-73ca-4caa-bd4f-f97065df4409 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:55:42 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] VM Resumed (Lifecycle Event)
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:55:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Instance spawned successfully.
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:42 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422942.2106383, 68dbaff0-73ca-4caa-bd4f-f97065df4409 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:55:42 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] VM Started (Lifecycle Event)
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:55:42 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:55:42 user nova-compute[71325]: INFO nova.compute.manager [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Took 6.20 seconds to spawn the instance on the hypervisor.
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:42 user nova-compute[71325]: INFO nova.compute.manager [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Rescuing
Apr 13 21:55:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquired lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.network.neutron [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:55:42 user nova-compute[71325]: INFO nova.compute.manager [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Took 7.13 seconds to build instance.
Apr 13 21:55:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.247s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG nova.network.neutron [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Updating instance_info_cache with network_info: [{"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:55:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Releasing lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "9c729f61-da40-49d7-8f93-d9bbe30fa877" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "9c729f61-da40-49d7-8f93-d9bbe30fa877" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:55:43 user nova-compute[71325]: INFO nova.compute.claims [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Claim successful on node user
Apr 13 21:55:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:43 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Instance destroyed successfully.
Apr 13 21:55:43 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Attempting rescue
Apr 13 21:55:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71325) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Instance directory exists: not creating {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 21:55:43 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Creating image(s)
Apr 13 21:55:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "/opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "/opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "/opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG nova.objects.instance [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'trusted_certs' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.rescue {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.network.neutron [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.rescue" returned: 0 in 0.064s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.objects.instance [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'migration_context' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:44 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Start _get_guest_xml network_info=[{"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "vif_mac": "fa:16:3e:79:ad:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.objects.instance [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'resources' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.objects.instance [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'numa_topology' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:55:44 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:55:44 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.objects.instance [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'vcpu_model' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-vif-unplugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] No waiting events found dispatching network-vif-unplugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:55:44 user nova-compute[71325]: WARNING nova.compute.manager [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received unexpected event network-vif-unplugged-a438af72-b7ff-4ab6-82f5-59cf460c430f for instance with vm_state active and task_state rescuing.
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] No waiting events found dispatching network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:55:44 user nova-compute[71325]: WARNING nova.compute.manager [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received unexpected event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f for instance with vm_state active and task_state rescuing.
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-83885280',display_name='tempest-ServerRescueNegativeTestJSON-server-83885280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-83885280',id=23,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEkikMBfKYBaVz9RAPAAHtgluCulNhaXlNnXRmd1wytRaQFaosDdHshmuQB0as4KbHDZo1Ux4sl5RXfhe13p5VrH2Y8uYO2igQjKNR7Nb3FHusXdWK16NLMOw2+fvY10Q==',key_name='tempest-keypair-1299306137',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:53:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70e84a09a76a44eb830e575db4321224',ramdisk_id='',reservation_id='r-3v2jgje0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-546430736',owner_user_name='tempest-ServerRescueNegativeTestJSON-546430736-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:53:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e77459bc3fa8496da1a089c460e32ed2',uuid=b87dfe1b-f651-436d-87b5-eb257ef1a6e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "vif_mac": "fa:16:3e:79:ad:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converting VIF {"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "vif_mac": "fa:16:3e:79:ad:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:ad:c6,bridge_name='br-int',has_traffic_filtering=True,id=a438af72-b7ff-4ab6-82f5-59cf460c430f,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa438af72-b7') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.objects.instance [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'pci_devices' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.policy [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:55:44 user nova-compute[71325]:   <uuid>b87dfe1b-f651-436d-87b5-eb257ef1a6e8</uuid>
Apr 13 21:55:44 user nova-compute[71325]:   <name>instance-00000017</name>
Apr 13 21:55:44 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:55:44 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:55:44 user nova-compute[71325]:   <metadata>
Apr 13 21:55:44 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:55:44 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:55:44 user nova-compute[71325]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-83885280</nova:name>
Apr 13 21:55:44 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:55:44</nova:creationTime>
Apr 13 21:55:44 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:55:44 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:55:44 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:55:44 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:55:44 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:55:44 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:55:44 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:55:44 user nova-compute[71325]:       <nova:owner>
Apr 13 21:55:44 user nova-compute[71325]:         <nova:user uuid="e77459bc3fa8496da1a089c460e32ed2">tempest-ServerRescueNegativeTestJSON-546430736-project-member</nova:user>
Apr 13 21:55:44 user nova-compute[71325]:         <nova:project uuid="70e84a09a76a44eb830e575db4321224">tempest-ServerRescueNegativeTestJSON-546430736</nova:project>
Apr 13 21:55:44 user nova-compute[71325]:       </nova:owner>
Apr 13 21:55:44 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:55:44 user nova-compute[71325]:       <nova:ports>
Apr 13 21:55:44 user nova-compute[71325]:         <nova:port uuid="a438af72-b7ff-4ab6-82f5-59cf460c430f">
Apr 13 21:55:44 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 21:55:44 user nova-compute[71325]:         </nova:port>
Apr 13 21:55:44 user nova-compute[71325]:       </nova:ports>
Apr 13 21:55:44 user nova-compute[71325]:     </nova:instance>
Apr 13 21:55:44 user nova-compute[71325]:   </metadata>
Apr 13 21:55:44 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:55:44 user nova-compute[71325]:     <system>
Apr 13 21:55:44 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:55:44 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:55:44 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:55:44 user nova-compute[71325]:       <entry name="serial">b87dfe1b-f651-436d-87b5-eb257ef1a6e8</entry>
Apr 13 21:55:44 user nova-compute[71325]:       <entry name="uuid">b87dfe1b-f651-436d-87b5-eb257ef1a6e8</entry>
Apr 13 21:55:44 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:55:44 user nova-compute[71325]:     </system>
Apr 13 21:55:44 user nova-compute[71325]:   </sysinfo>
Apr 13 21:55:44 user nova-compute[71325]:   <os>
Apr 13 21:55:44 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:55:44 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:55:44 user nova-compute[71325]:   </os>
Apr 13 21:55:44 user nova-compute[71325]:   <features>
Apr 13 21:55:44 user nova-compute[71325]:     <acpi/>
Apr 13 21:55:44 user nova-compute[71325]:     <apic/>
Apr 13 21:55:44 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:55:44 user nova-compute[71325]:   </features>
Apr 13 21:55:44 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:55:44 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:55:44 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:55:44 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:55:44 user nova-compute[71325]:   </clock>
Apr 13 21:55:44 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:55:44 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:55:44 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:55:44 user nova-compute[71325]:   </cpu>
Apr 13 21:55:44 user nova-compute[71325]:   <devices>
Apr 13 21:55:44 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:55:44 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:55:44 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.rescue"/>
Apr 13 21:55:44 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:55:44 user nova-compute[71325]:     </disk>
Apr 13 21:55:44 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:55:44 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:55:44 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk"/>
Apr 13 21:55:44 user nova-compute[71325]:       <target dev="vdb" bus="virtio"/>
Apr 13 21:55:44 user nova-compute[71325]:     </disk>
Apr 13 21:55:44 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:55:44 user nova-compute[71325]:       <mac address="fa:16:3e:79:ad:c6"/>
Apr 13 21:55:44 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:55:44 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:55:44 user nova-compute[71325]:       <target dev="tapa438af72-b7"/>
Apr 13 21:55:44 user nova-compute[71325]:     </interface>
Apr 13 21:55:44 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:55:44 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/console.log" append="off"/>
Apr 13 21:55:44 user nova-compute[71325]:     </serial>
Apr 13 21:55:44 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:55:44 user nova-compute[71325]:     <video>
Apr 13 21:55:44 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:55:44 user nova-compute[71325]:     </video>
Apr 13 21:55:44 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:55:44 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:55:44 user nova-compute[71325]:     </rng>
Apr 13 21:55:44 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:55:44 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:55:44 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:55:44 user nova-compute[71325]:     </memballoon>
Apr 13 21:55:44 user nova-compute[71325]:   </devices>
Apr 13 21:55:44 user nova-compute[71325]: </domain>
Apr 13 21:55:44 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:55:44 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Instance destroyed successfully.
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:55:44 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Creating image(s)
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "/opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "/opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] No VIF found with MAC fa:16:3e:79:ad:c6, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.169s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk 1073741824" returned: 0 in 0.113s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.161s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:55:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:45 user nova-compute[71325]: DEBUG nova.network.neutron [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Successfully created port: 330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:55:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:55:45 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Cannot resize image /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:55:45 user nova-compute[71325]: DEBUG nova.objects.instance [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'migration_context' on Instance uuid 9c729f61-da40-49d7-8f93-d9bbe30fa877 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:55:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Ensure instance console log exists: /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:55:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:45 user nova-compute[71325]: INFO nova.compute.manager [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Unrescuing
Apr 13 21:55:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:55:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquired lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:55:45 user nova-compute[71325]: DEBUG nova.network.neutron [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:55:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.network.neutron [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Updating instance_info_cache with network_info: [{"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Releasing lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.objects.instance [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'flavor' on Instance uuid 6fbf2022-b069-440f-8513-6d107f0a7180 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-5a6f242c-7cd3-4024-a6e8-a9fd40d48d47 req-d5a338ff-eb67-47e1-acc0-3c240fc31b46 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5a6f242c-7cd3-4024-a6e8-a9fd40d48d47 req-d5a338ff-eb67-47e1-acc0-3c240fc31b46 service nova] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5a6f242c-7cd3-4024-a6e8-a9fd40d48d47 req-d5a338ff-eb67-47e1-acc0-3c240fc31b46 service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5a6f242c-7cd3-4024-a6e8-a9fd40d48d47 req-d5a338ff-eb67-47e1-acc0-3c240fc31b46 service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-5a6f242c-7cd3-4024-a6e8-a9fd40d48d47 req-d5a338ff-eb67-47e1-acc0-3c240fc31b46 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] No waiting events found dispatching network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:55:46 user nova-compute[71325]: WARNING nova.compute.manager [req-5a6f242c-7cd3-4024-a6e8-a9fd40d48d47 req-d5a338ff-eb67-47e1-acc0-3c240fc31b46 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received unexpected event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f for instance with vm_state active and task_state rescuing.
Apr 13 21:55:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.network.neutron [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Successfully updated port: 330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "refresh_cache-9c729f61-da40-49d7-8f93-d9bbe30fa877" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquired lock "refresh_cache-9c729f61-da40-49d7-8f93-d9bbe30fa877" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.network.neutron [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-be4a21a0-4fc8-4a7d-a92b-c899e9e45d9b req-a169815b-217c-47f5-b264-a7d8ed122d6d service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Received event network-changed-330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-be4a21a0-4fc8-4a7d-a92b-c899e9e45d9b req-a169815b-217c-47f5-b264-a7d8ed122d6d service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Refreshing instance network info cache due to event network-changed-330b43f2-b324-4cbf-953e-7225711aa856. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-be4a21a0-4fc8-4a7d-a92b-c899e9e45d9b req-a169815b-217c-47f5-b264-a7d8ed122d6d service nova] Acquiring lock "refresh_cache-9c729f61-da40-49d7-8f93-d9bbe30fa877" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.network.neutron [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.network.neutron [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Updating instance_info_cache with network_info: [{"id": "330b43f2-b324-4cbf-953e-7225711aa856", "address": "fa:16:3e:fd:11:8e", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330b43f2-b3", "ovs_interfaceid": "330b43f2-b324-4cbf-953e-7225711aa856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:55:46 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Instance destroyed successfully.
Apr 13 21:55:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Releasing lock "refresh_cache-9c729f61-da40-49d7-8f93-d9bbe30fa877" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Instance network_info: |[{"id": "330b43f2-b324-4cbf-953e-7225711aa856", "address": "fa:16:3e:fd:11:8e", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330b43f2-b3", "ovs_interfaceid": "330b43f2-b324-4cbf-953e-7225711aa856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-be4a21a0-4fc8-4a7d-a92b-c899e9e45d9b req-a169815b-217c-47f5-b264-a7d8ed122d6d service nova] Acquired lock "refresh_cache-9c729f61-da40-49d7-8f93-d9bbe30fa877" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.network.neutron [req-be4a21a0-4fc8-4a7d-a92b-c899e9e45d9b req-a169815b-217c-47f5-b264-a7d8ed122d6d service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Refreshing network info cache for port 330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Start _get_guest_xml network_info=[{"id": "330b43f2-b324-4cbf-953e-7225711aa856", "address": "fa:16:3e:fd:11:8e", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330b43f2-b3", "ovs_interfaceid": "330b43f2-b324-4cbf-953e-7225711aa856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:55:46 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:55:46 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:55:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-478774448',display_name='tempest-AttachVolumeNegativeTest-server-478774448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-478774448',id=27,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZc162tVythJhaJKRScqNIf+KMZxBjwe1ZrmXTBaQ3UKcFvBbLYWcAWzW2akMkMDvhbMf7BPoc9Gk1B4keTA03dVAmolivOo4U4/bjoKaWU2eORcyTrFfFocUk/JK/A2Q==',key_name='tempest-keypair-938295147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446b51db737947ab9bddd5fc47488bc7',ramdisk_id='',reservation_id='r-3r70nw0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-920375840',owner_user_name='tempest-AttachVolumeNegativeTest-920375840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145c0a177fcc4b94b5480d8806554ac9',uuid=9c729f61-da40-49d7-8f93-d9bbe30fa877,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "330b43f2-b324-4cbf-953e-7225711aa856", "address": "fa:16:3e:fd:11:8e", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330b43f2-b3", "ovs_interfaceid": "330b43f2-b324-4cbf-953e-7225711aa856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converting VIF {"id": "330b43f2-b324-4cbf-953e-7225711aa856", "address": "fa:16:3e:fd:11:8e", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330b43f2-b3", "ovs_interfaceid": "330b43f2-b324-4cbf-953e-7225711aa856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:11:8e,bridge_name='br-int',has_traffic_filtering=True,id=330b43f2-b324-4cbf-953e-7225711aa856,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330b43f2-b3') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG nova.objects.instance [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c729f61-da40-49d7-8f93-d9bbe30fa877 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:55:47 user nova-compute[71325]:   <uuid>9c729f61-da40-49d7-8f93-d9bbe30fa877</uuid>
Apr 13 21:55:47 user nova-compute[71325]:   <name>instance-0000001b</name>
Apr 13 21:55:47 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:55:47 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:55:47 user nova-compute[71325]:   <metadata>
Apr 13 21:55:47 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:55:47 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:55:47 user nova-compute[71325]:       <nova:name>tempest-AttachVolumeNegativeTest-server-478774448</nova:name>
Apr 13 21:55:47 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:55:46</nova:creationTime>
Apr 13 21:55:47 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:55:47 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:55:47 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:55:47 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:55:47 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:55:47 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:55:47 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:55:47 user nova-compute[71325]:       <nova:owner>
Apr 13 21:55:47 user nova-compute[71325]:         <nova:user uuid="145c0a177fcc4b94b5480d8806554ac9">tempest-AttachVolumeNegativeTest-920375840-project-member</nova:user>
Apr 13 21:55:47 user nova-compute[71325]:         <nova:project uuid="446b51db737947ab9bddd5fc47488bc7">tempest-AttachVolumeNegativeTest-920375840</nova:project>
Apr 13 21:55:47 user nova-compute[71325]:       </nova:owner>
Apr 13 21:55:47 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:55:47 user nova-compute[71325]:       <nova:ports>
Apr 13 21:55:47 user nova-compute[71325]:         <nova:port uuid="330b43f2-b324-4cbf-953e-7225711aa856">
Apr 13 21:55:47 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 21:55:47 user nova-compute[71325]:         </nova:port>
Apr 13 21:55:47 user nova-compute[71325]:       </nova:ports>
Apr 13 21:55:47 user nova-compute[71325]:     </nova:instance>
Apr 13 21:55:47 user nova-compute[71325]:   </metadata>
Apr 13 21:55:47 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:55:47 user nova-compute[71325]:     <system>
Apr 13 21:55:47 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:55:47 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:55:47 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:55:47 user nova-compute[71325]:       <entry name="serial">9c729f61-da40-49d7-8f93-d9bbe30fa877</entry>
Apr 13 21:55:47 user nova-compute[71325]:       <entry name="uuid">9c729f61-da40-49d7-8f93-d9bbe30fa877</entry>
Apr 13 21:55:47 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:55:47 user nova-compute[71325]:     </system>
Apr 13 21:55:47 user nova-compute[71325]:   </sysinfo>
Apr 13 21:55:47 user nova-compute[71325]:   <os>
Apr 13 21:55:47 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:55:47 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:55:47 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:55:47 user nova-compute[71325]:   </os>
Apr 13 21:55:47 user nova-compute[71325]:   <features>
Apr 13 21:55:47 user nova-compute[71325]:     <acpi/>
Apr 13 21:55:47 user nova-compute[71325]:     <apic/>
Apr 13 21:55:47 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:55:47 user nova-compute[71325]:   </features>
Apr 13 21:55:47 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:55:47 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:55:47 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:55:47 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:55:47 user nova-compute[71325]:   </clock>
Apr 13 21:55:47 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:55:47 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:55:47 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:55:47 user nova-compute[71325]:   </cpu>
Apr 13 21:55:47 user nova-compute[71325]:   <devices>
Apr 13 21:55:47 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:55:47 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:55:47 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk"/>
Apr 13 21:55:47 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:55:47 user nova-compute[71325]:     </disk>
Apr 13 21:55:47 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:55:47 user nova-compute[71325]:       <mac address="fa:16:3e:fd:11:8e"/>
Apr 13 21:55:47 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:55:47 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:55:47 user nova-compute[71325]:       <target dev="tap330b43f2-b3"/>
Apr 13 21:55:47 user nova-compute[71325]:     </interface>
Apr 13 21:55:47 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:55:47 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/console.log" append="off"/>
Apr 13 21:55:47 user nova-compute[71325]:     </serial>
Apr 13 21:55:47 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:55:47 user nova-compute[71325]:     <video>
Apr 13 21:55:47 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:55:47 user nova-compute[71325]:     </video>
Apr 13 21:55:47 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:55:47 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:55:47 user nova-compute[71325]:     </rng>
Apr 13 21:55:47 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:55:47 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:55:47 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:55:47 user nova-compute[71325]:     </memballoon>
Apr 13 21:55:47 user nova-compute[71325]:   </devices>
Apr 13 21:55:47 user nova-compute[71325]: </domain>
Apr 13 21:55:47 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-478774448',display_name='tempest-AttachVolumeNegativeTest-server-478774448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-478774448',id=27,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZc162tVythJhaJKRScqNIf+KMZxBjwe1ZrmXTBaQ3UKcFvBbLYWcAWzW2akMkMDvhbMf7BPoc9Gk1B4keTA03dVAmolivOo4U4/bjoKaWU2eORcyTrFfFocUk/JK/A2Q==',key_name='tempest-keypair-938295147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446b51db737947ab9bddd5fc47488bc7',ramdisk_id='',reservation_id='r-3r70nw0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-920375840',owner_user_name='tempest-AttachVolumeNegativeTest-920375840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145c0a177fcc4b94b5480d8806554ac9',uuid=9c729f61-da40-49d7-8f93-d9bbe30fa877,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "330b43f2-b324-4cbf-953e-7225711aa856", "address": "fa:16:3e:fd:11:8e", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330b43f2-b3", "ovs_interfaceid": "330b43f2-b324-4cbf-953e-7225711aa856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converting VIF {"id": "330b43f2-b324-4cbf-953e-7225711aa856", "address": "fa:16:3e:fd:11:8e", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330b43f2-b3", "ovs_interfaceid": "330b43f2-b324-4cbf-953e-7225711aa856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:11:8e,bridge_name='br-int',has_traffic_filtering=True,id=330b43f2-b324-4cbf-953e-7225711aa856,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330b43f2-b3') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG os_vif [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:11:8e,bridge_name='br-int',has_traffic_filtering=True,id=330b43f2-b324-4cbf-953e-7225711aa856,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330b43f2-b3') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap330b43f2-b3, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap330b43f2-b3, col_values=(('external_ids', {'iface-id': '330b43f2-b324-4cbf-953e-7225711aa856', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:11:8e', 'vm-uuid': '9c729f61-da40-49d7-8f93-d9bbe30fa877'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:47 user nova-compute[71325]: INFO os_vif [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:11:8e,bridge_name='br-int',has_traffic_filtering=True,id=330b43f2-b324-4cbf-953e-7225711aa856,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330b43f2-b3')
Apr 13 21:55:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No VIF found with MAC fa:16:3e:fd:11:8e, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG nova.network.neutron [req-be4a21a0-4fc8-4a7d-a92b-c899e9e45d9b req-a169815b-217c-47f5-b264-a7d8ed122d6d service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Updated VIF entry in instance network info cache for port 330b43f2-b324-4cbf-953e-7225711aa856. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG nova.network.neutron [req-be4a21a0-4fc8-4a7d-a92b-c899e9e45d9b req-a169815b-217c-47f5-b264-a7d8ed122d6d service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Updating instance_info_cache with network_info: [{"id": "330b43f2-b324-4cbf-953e-7225711aa856", "address": "fa:16:3e:fd:11:8e", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330b43f2-b3", "ovs_interfaceid": "330b43f2-b324-4cbf-953e-7225711aa856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:55:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-be4a21a0-4fc8-4a7d-a92b-c899e9e45d9b req-a169815b-217c-47f5-b264-a7d8ed122d6d service nova] Releasing lock "refresh_cache-9c729f61-da40-49d7-8f93-d9bbe30fa877" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for b87dfe1b-f651-436d-87b5-eb257ef1a6e8 due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422948.2212038, b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:55:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] VM Resumed (Lifecycle Event)
Apr 13 21:55:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] No waiting events found dispatching network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:55:48 user nova-compute[71325]: WARNING nova.compute.manager [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received unexpected event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f for instance with vm_state active and task_state rescuing.
Apr 13 21:55:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-vif-unplugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] No waiting events found dispatching network-vif-unplugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:55:48 user nova-compute[71325]: WARNING nova.compute.manager [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received unexpected event network-vif-unplugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:55:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] No waiting events found dispatching network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:55:48 user nova-compute[71325]: WARNING nova.compute.manager [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received unexpected event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:55:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 21:55:48 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422948.2266135, b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:55:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] VM Started (Lifecycle Event)
Apr 13 21:55:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:55:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-54f29e05-6cda-493b-8355-44d522b355b9 req-85f84c43-d8af-449e-8659-43b086c4cfce service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Received event network-vif-plugged-330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-54f29e05-6cda-493b-8355-44d522b355b9 req-85f84c43-d8af-449e-8659-43b086c4cfce service nova] Acquiring lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-54f29e05-6cda-493b-8355-44d522b355b9 req-85f84c43-d8af-449e-8659-43b086c4cfce service nova] Lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-54f29e05-6cda-493b-8355-44d522b355b9 req-85f84c43-d8af-449e-8659-43b086c4cfce service nova] Lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-54f29e05-6cda-493b-8355-44d522b355b9 req-85f84c43-d8af-449e-8659-43b086c4cfce service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] No waiting events found dispatching network-vif-plugged-330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:55:49 user nova-compute[71325]: WARNING nova.compute.manager [req-54f29e05-6cda-493b-8355-44d522b355b9 req-85f84c43-d8af-449e-8659-43b086c4cfce service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Received unexpected event network-vif-plugged-330b43f2-b324-4cbf-953e-7225711aa856 for instance with vm_state building and task_state spawning.
Apr 13 21:55:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:50 user nova-compute[71325]: DEBUG nova.compute.manager [req-3dbb8430-4aaa-4406-805e-088e2f56b604 req-0bf54581-6b80-4281-9c14-1c6213c504cc service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3dbb8430-4aaa-4406-805e-088e2f56b604 req-0bf54581-6b80-4281-9c14-1c6213c504cc service nova] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3dbb8430-4aaa-4406-805e-088e2f56b604 req-0bf54581-6b80-4281-9c14-1c6213c504cc service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3dbb8430-4aaa-4406-805e-088e2f56b604 req-0bf54581-6b80-4281-9c14-1c6213c504cc service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:50 user nova-compute[71325]: DEBUG nova.compute.manager [req-3dbb8430-4aaa-4406-805e-088e2f56b604 req-0bf54581-6b80-4281-9c14-1c6213c504cc service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] No waiting events found dispatching network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:55:50 user nova-compute[71325]: WARNING nova.compute.manager [req-3dbb8430-4aaa-4406-805e-088e2f56b604 req-0bf54581-6b80-4281-9c14-1c6213c504cc service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received unexpected event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:55:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-db2a4cf1-8b08-4331-81eb-78247c96eba8 req-4928ce3e-1524-4c17-a63a-ffb383b1be74 service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Received event network-vif-plugged-330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-db2a4cf1-8b08-4331-81eb-78247c96eba8 req-4928ce3e-1524-4c17-a63a-ffb383b1be74 service nova] Acquiring lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-db2a4cf1-8b08-4331-81eb-78247c96eba8 req-4928ce3e-1524-4c17-a63a-ffb383b1be74 service nova] Lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-db2a4cf1-8b08-4331-81eb-78247c96eba8 req-4928ce3e-1524-4c17-a63a-ffb383b1be74 service nova] Lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-db2a4cf1-8b08-4331-81eb-78247c96eba8 req-4928ce3e-1524-4c17-a63a-ffb383b1be74 service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] No waiting events found dispatching network-vif-plugged-330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:55:51 user nova-compute[71325]: WARNING nova.compute.manager [req-db2a4cf1-8b08-4331-81eb-78247c96eba8 req-4928ce3e-1524-4c17-a63a-ffb383b1be74 service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Received unexpected event network-vif-plugged-330b43f2-b324-4cbf-953e-7225711aa856 for instance with vm_state building and task_state spawning.
Apr 13 21:55:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-60a20664-c75c-4815-a128-eb2ceeb8344d req-7f4e8d7b-0a94-41ac-87e1-19c6d92e2e52 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-60a20664-c75c-4815-a128-eb2ceeb8344d req-7f4e8d7b-0a94-41ac-87e1-19c6d92e2e52 service nova] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-60a20664-c75c-4815-a128-eb2ceeb8344d req-7f4e8d7b-0a94-41ac-87e1-19c6d92e2e52 service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-60a20664-c75c-4815-a128-eb2ceeb8344d req-7f4e8d7b-0a94-41ac-87e1-19c6d92e2e52 service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-60a20664-c75c-4815-a128-eb2ceeb8344d req-7f4e8d7b-0a94-41ac-87e1-19c6d92e2e52 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] No waiting events found dispatching network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:55:52 user nova-compute[71325]: WARNING nova.compute.manager [req-60a20664-c75c-4815-a128-eb2ceeb8344d req-7f4e8d7b-0a94-41ac-87e1-19c6d92e2e52 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received unexpected event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for 6fbf2022-b069-440f-8513-6d107f0a7180 due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422952.3966138, 6fbf2022-b069-440f-8513-6d107f0a7180 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:55:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] VM Resumed (Lifecycle Event)
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:55:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422952.4032378, 6fbf2022-b069-440f-8513-6d107f0a7180 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:55:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] VM Started (Lifecycle Event)
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422952.5342174, 9c729f61-da40-49d7-8f93-d9bbe30fa877 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:55:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] VM Resumed (Lifecycle Event)
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Instance spawned successfully.
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:55:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422952.5441375, 9c729f61-da40-49d7-8f93-d9bbe30fa877 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:55:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] VM Started (Lifecycle Event)
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:55:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:55:52 user nova-compute[71325]: INFO nova.compute.manager [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Took 8.48 seconds to spawn the instance on the hypervisor.
Apr 13 21:55:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:55:52 user nova-compute[71325]: INFO nova.compute.manager [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Took 9.49 seconds to build instance.
Apr 13 21:55:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "9c729f61-da40-49d7-8f93-d9bbe30fa877" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.597s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:55:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:55:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:00 user nova-compute[71325]: INFO nova.compute.manager [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Terminating instance
Apr 13 21:56:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Cleaning up deleted instances {{(pid=71325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] There are 0 instances to clean {{(pid=71325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-8d22b19e-1a0c-4e41-91e4-347404b16cd1 req-7ba9c6f9-78a3-46f0-aebe-baf6979338be service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Received event network-vif-unplugged-0dee1237-d171-40d9-ab20-6744df05223b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8d22b19e-1a0c-4e41-91e4-347404b16cd1 req-7ba9c6f9-78a3-46f0-aebe-baf6979338be service nova] Acquiring lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8d22b19e-1a0c-4e41-91e4-347404b16cd1 req-7ba9c6f9-78a3-46f0-aebe-baf6979338be service nova] Lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8d22b19e-1a0c-4e41-91e4-347404b16cd1 req-7ba9c6f9-78a3-46f0-aebe-baf6979338be service nova] Lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-8d22b19e-1a0c-4e41-91e4-347404b16cd1 req-7ba9c6f9-78a3-46f0-aebe-baf6979338be service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] No waiting events found dispatching network-vif-unplugged-0dee1237-d171-40d9-ab20-6744df05223b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:56:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-8d22b19e-1a0c-4e41-91e4-347404b16cd1 req-7ba9c6f9-78a3-46f0-aebe-baf6979338be service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Received event network-vif-unplugged-0dee1237-d171-40d9-ab20-6744df05223b for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:56:01 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Instance destroyed successfully.
Apr 13 21:56:01 user nova-compute[71325]: DEBUG nova.objects.instance [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lazy-loading 'resources' on Instance uuid a3489f51-3982-4ddd-9a38-fde0b31e5b45 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:56:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:54:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-38090163',display_name='tempest-VolumesActionsTest-instance-38090163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-38090163',id=24,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:54:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efd2e9bf0c5345f6bd3f030fb9f55e03',ramdisk_id='',reservation_id='r-uschs1zs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1838938247',owner_user_name='tempest-VolumesActionsTest-1838938247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:54:17Z,user_data=None,user_id='9fe6b951236f4a96a2ac12a5dea4602a',uuid=a3489f51-3982-4ddd-9a38-fde0b31e5b45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dee1237-d171-40d9-ab20-6744df05223b", "address": "fa:16:3e:40:24:a0", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dee1237-d1", "ovs_interfaceid": "0dee1237-d171-40d9-ab20-6744df05223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:56:01 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Converting VIF {"id": "0dee1237-d171-40d9-ab20-6744df05223b", "address": "fa:16:3e:40:24:a0", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dee1237-d1", "ovs_interfaceid": "0dee1237-d171-40d9-ab20-6744df05223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:56:01 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:24:a0,bridge_name='br-int',has_traffic_filtering=True,id=0dee1237-d171-40d9-ab20-6744df05223b,network=Network(dd758252-0db3-4d47-a231-c8a85e067e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dee1237-d1') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:56:01 user nova-compute[71325]: DEBUG os_vif [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:24:a0,bridge_name='br-int',has_traffic_filtering=True,id=0dee1237-d171-40d9-ab20-6744df05223b,network=Network(dd758252-0db3-4d47-a231-c8a85e067e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dee1237-d1') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:56:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dee1237-d1, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:56:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:56:01 user nova-compute[71325]: INFO os_vif [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:24:a0,bridge_name='br-int',has_traffic_filtering=True,id=0dee1237-d171-40d9-ab20-6744df05223b,network=Network(dd758252-0db3-4d47-a231-c8a85e067e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dee1237-d1')
Apr 13 21:56:01 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Deleting instance files /opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45_del
Apr 13 21:56:01 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Deletion of /opt/stack/data/nova/instances/a3489f51-3982-4ddd-9a38-fde0b31e5b45_del complete
Apr 13 21:56:01 user nova-compute[71325]: INFO nova.compute.manager [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 21:56:01 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:56:01 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:56:01 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:56:01 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:56:01 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Took 0.53 seconds to deallocate network for instance.
Apr 13 21:56:01 user nova-compute[71325]: DEBUG nova.compute.manager [req-b94b7f17-edbb-45a1-af6b-cbbdfd4e37da req-60be27f8-d1d1-4f1e-a902-9ce0cf550776 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Received event network-vif-deleted-0dee1237-d171-40d9-ab20-6744df05223b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:56:01 user nova-compute[71325]: INFO nova.compute.manager [req-b94b7f17-edbb-45a1-af6b-cbbdfd4e37da req-60be27f8-d1d1-4f1e-a902-9ce0cf550776 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Neutron deleted interface 0dee1237-d171-40d9-ab20-6744df05223b; detaching it from the instance and deleting it from the info cache
Apr 13 21:56:01 user nova-compute[71325]: DEBUG nova.network.neutron [req-b94b7f17-edbb-45a1-af6b-cbbdfd4e37da req-60be27f8-d1d1-4f1e-a902-9ce0cf550776 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:56:01 user nova-compute[71325]: DEBUG nova.compute.manager [req-b94b7f17-edbb-45a1-af6b-cbbdfd4e37da req-60be27f8-d1d1-4f1e-a902-9ce0cf550776 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Detach interface failed, port_id=0dee1237-d171-40d9-ab20-6744df05223b, reason: Instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:56:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:02 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:56:02 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:56:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:02 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Deleted allocations for instance a3489f51-3982-4ddd-9a38-fde0b31e5b45
Apr 13 21:56:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.248s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:02 user nova-compute[71325]: DEBUG nova.compute.manager [req-29822c6c-c6e4-4ba4-9d3f-16b5e11b0238 req-c82f05c4-a988-4a97-8521-9257dd31dbb2 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Received event network-vif-plugged-0dee1237-d171-40d9-ab20-6744df05223b {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:56:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-29822c6c-c6e4-4ba4-9d3f-16b5e11b0238 req-c82f05c4-a988-4a97-8521-9257dd31dbb2 service nova] Acquiring lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-29822c6c-c6e4-4ba4-9d3f-16b5e11b0238 req-c82f05c4-a988-4a97-8521-9257dd31dbb2 service nova] Lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-29822c6c-c6e4-4ba4-9d3f-16b5e11b0238 req-c82f05c4-a988-4a97-8521-9257dd31dbb2 service nova] Lock "a3489f51-3982-4ddd-9a38-fde0b31e5b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:02 user nova-compute[71325]: DEBUG nova.compute.manager [req-29822c6c-c6e4-4ba4-9d3f-16b5e11b0238 req-c82f05c4-a988-4a97-8521-9257dd31dbb2 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] No waiting events found dispatching network-vif-plugged-0dee1237-d171-40d9-ab20-6744df05223b {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:56:02 user nova-compute[71325]: WARNING nova.compute.manager [req-29822c6c-c6e4-4ba4-9d3f-16b5e11b0238 req-c82f05c4-a988-4a97-8521-9257dd31dbb2 service nova] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Received unexpected event network-vif-plugged-0dee1237-d171-40d9-ab20-6744df05223b for instance with vm_state deleted and task_state None.
Apr 13 21:56:04 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:56:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:08 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:56:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:56:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:56:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:56:08 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:56:09 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating instance_info_cache with network_info: [{"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:56:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:56:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:56:09 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:56:09 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:56:09 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:56:09 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:56:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71325) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 21:56:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:10 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:56:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:10 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:56:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:56:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:11 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:56:14 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:56:14 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7468MB free_disk=26.085533142089844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 03554793-01dd-4629-97c7-b640f5934639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 64f496e7-47db-4602-850e-0260d5858049 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:56:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:56:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:56:16 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681422961.3025997, a3489f51-3982-4ddd-9a38-fde0b31e5b45 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:56:16 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] VM Stopped (Lifecycle Event)
Apr 13 21:56:16 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3c2cad6f-0402-4b69-8d6d-071ff158dc14 None None] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:56:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:16 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:56:17 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:56:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:56:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:28 user nova-compute[71325]: INFO nova.compute.manager [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Unshelving
Apr 13 21:56:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:28 user nova-compute[71325]: DEBUG nova.objects.instance [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'pci_requests' on Instance uuid 2d1990a1-40ec-4c02-941f-813c22e8cd8f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:56:28 user nova-compute[71325]: DEBUG nova.objects.instance [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'numa_topology' on Instance uuid 2d1990a1-40ec-4c02-941f-813c22e8cd8f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:56:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:56:28 user nova-compute[71325]: INFO nova.compute.claims [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Claim successful on node user
Apr 13 21:56:28 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:56:28 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:56:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:28 user nova-compute[71325]: INFO nova.network.neutron [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Updating port 596fdd61-68e0-4968-9d6a-e70d32a61ea1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG nova.compute.manager [req-8bfca00a-c6ba-4166-b400-5d29bc21eafd req-c3037a69-a4fa-4dcc-b993-1f45d9db4a77 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-changed-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG nova.compute.manager [req-8bfca00a-c6ba-4166-b400-5d29bc21eafd req-c3037a69-a4fa-4dcc-b993-1f45d9db4a77 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Refreshing instance network info cache due to event network-changed-0150fcfb-793e-4d51-966c-c30195a9802f. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8bfca00a-c6ba-4166-b400-5d29bc21eafd req-c3037a69-a4fa-4dcc-b993-1f45d9db4a77 service nova] Acquiring lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8bfca00a-c6ba-4166-b400-5d29bc21eafd req-c3037a69-a4fa-4dcc-b993-1f45d9db4a77 service nova] Acquired lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG nova.network.neutron [req-8bfca00a-c6ba-4166-b400-5d29bc21eafd req-c3037a69-a4fa-4dcc-b993-1f45d9db4a77 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Refreshing network info cache for port 0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquired lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG nova.network.neutron [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG nova.compute.manager [req-b3865c9e-c73f-4493-ad60-9456538bbaa7 req-f8fa17ba-4f82-46a6-8d70-0c779efc8412 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received event network-changed-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG nova.compute.manager [req-b3865c9e-c73f-4493-ad60-9456538bbaa7 req-f8fa17ba-4f82-46a6-8d70-0c779efc8412 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Refreshing instance network info cache due to event network-changed-596fdd61-68e0-4968-9d6a-e70d32a61ea1. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b3865c9e-c73f-4493-ad60-9456538bbaa7 req-f8fa17ba-4f82-46a6-8d70-0c779efc8412 service nova] Acquiring lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG nova.network.neutron [req-8bfca00a-c6ba-4166-b400-5d29bc21eafd req-c3037a69-a4fa-4dcc-b993-1f45d9db4a77 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Updated VIF entry in instance network info cache for port 0150fcfb-793e-4d51-966c-c30195a9802f. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG nova.network.neutron [req-8bfca00a-c6ba-4166-b400-5d29bc21eafd req-c3037a69-a4fa-4dcc-b993-1f45d9db4a77 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Updating instance_info_cache with network_info: [{"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8bfca00a-c6ba-4166-b400-5d29bc21eafd req-c3037a69-a4fa-4dcc-b993-1f45d9db4a77 service nova] Releasing lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG nova.network.neutron [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Updating instance_info_cache with network_info: [{"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Releasing lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:56:29 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Creating image(s)
Apr 13 21:56:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "/opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "/opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG nova.objects.instance [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2d1990a1-40ec-4c02-941f-813c22e8cd8f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b3865c9e-c73f-4493-ad60-9456538bbaa7 req-f8fa17ba-4f82-46a6-8d70-0c779efc8412 service nova] Acquired lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG nova.network.neutron [req-b3865c9e-c73f-4493-ad60-9456538bbaa7 req-f8fa17ba-4f82-46a6-8d70-0c779efc8412 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Refreshing network info cache for port 596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "831d13e04670a700e34bb7ca13422d6bb43eb586" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "831d13e04670a700e34bb7ca13422d6bb43eb586" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586.part --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "03554793-01dd-4629-97c7-b640f5934639" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:30 user nova-compute[71325]: INFO nova.compute.manager [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Detaching volume 95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4
Apr 13 21:56:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586.part --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:30 user nova-compute[71325]: DEBUG nova.virt.images [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] f514bce4-97a1-4dc6-b168-c629de2da778 was qcow2, converting to raw {{(pid=71325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 21:56:30 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:56:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586.part /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586.converted {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:30 user nova-compute[71325]: INFO nova.virt.block_device [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Attempting to driver detach volume 95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 from mountpoint /dev/vdb
Apr 13 21:56:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Attempting to detach device vdb from instance 03554793-01dd-4629-97c7-b640f5934639 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:56:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:56:30 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:56:30 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 21:56:30 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:56:30 user nova-compute[71325]:   <serial>95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4</serial>
Apr 13 21:56:30 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:56:30 user nova-compute[71325]: </disk>
Apr 13 21:56:30 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:56:30 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Successfully detached device vdb from instance 03554793-01dd-4629-97c7-b640f5934639 from the persistent domain config.
Apr 13 21:56:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03554793-01dd-4629-97c7-b640f5934639 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:56:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:56:30 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:56:30 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 21:56:30 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:56:30 user nova-compute[71325]:   <serial>95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4</serial>
Apr 13 21:56:30 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:56:30 user nova-compute[71325]: </disk>
Apr 13 21:56:30 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586.part /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586.converted" returned: 0 in 0.290s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586.converted --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG nova.network.neutron [req-b3865c9e-c73f-4493-ad60-9456538bbaa7 req-f8fa17ba-4f82-46a6-8d70-0c779efc8412 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Updated VIF entry in instance network info cache for port 596fdd61-68e0-4968-9d6a-e70d32a61ea1. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG nova.network.neutron [req-b3865c9e-c73f-4493-ad60-9456538bbaa7 req-f8fa17ba-4f82-46a6-8d70-0c779efc8412 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Updating instance_info_cache with network_info: [{"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b3865c9e-c73f-4493-ad60-9456538bbaa7 req-f8fa17ba-4f82-46a6-8d70-0c779efc8412 service nova] Releasing lock "refresh_cache-2d1990a1-40ec-4c02-941f-813c22e8cd8f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "831d13e04670a700e34bb7ca13422d6bb43eb586" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.376s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG nova.compute.manager [req-009b4e31-ca0f-47fc-83a6-0ea32b139981 req-3eca514f-81a7-4885-bff1-9b420a65e875 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-changed-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG nova.compute.manager [req-009b4e31-ca0f-47fc-83a6-0ea32b139981 req-3eca514f-81a7-4885-bff1-9b420a65e875 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Refreshing instance network info cache due to event network-changed-0150fcfb-793e-4d51-966c-c30195a9802f. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-009b4e31-ca0f-47fc-83a6-0ea32b139981 req-3eca514f-81a7-4885-bff1-9b420a65e875 service nova] Acquiring lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-009b4e31-ca0f-47fc-83a6-0ea32b139981 req-3eca514f-81a7-4885-bff1-9b420a65e875 service nova] Acquired lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG nova.network.neutron [req-009b4e31-ca0f-47fc-83a6-0ea32b139981 req-3eca514f-81a7-4885-bff1-9b420a65e875 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Refreshing network info cache for port 0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586 --force-share --output=json" returned: 0 in 0.173s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "831d13e04670a700e34bb7ca13422d6bb43eb586" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "831d13e04670a700e34bb7ca13422d6bb43eb586" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681422991.611459, 03554793-01dd-4629-97c7-b640f5934639 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03554793-01dd-4629-97c7-b640f5934639 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:56:31 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Successfully detached device vdb from instance 03554793-01dd-4629-97c7-b640f5934639 from the live domain config.
Apr 13 21:56:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfxYihPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:56:31 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:56:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586 --force-share --output=json" returned: 0 in 0.181s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586,backing_fmt=raw /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a189e591-a114-4ff7-864c-2fd6ac0befc9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:56:31 user nova-compute[71325]: No targets found.
Apr 13 21:56:31 user nova-compute[71325]: iSNS:
Apr 13 21:56:31 user nova-compute[71325]: No targets found.
Apr 13 21:56:31 user nova-compute[71325]: STATIC:
Apr 13 21:56:31 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41
Apr 13 21:56:31 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:56:31 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:56:31 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4
Apr 13 21:56:31 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:56:31 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:56:31 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:56:31 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:56:31 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:56:31 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808
Apr 13 21:56:31 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:56:31 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:56:31 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4
Apr 13 21:56:31 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:56:31 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:56:31 user nova-compute[71325]: FIRMWARE:
Apr 13 21:56:31 user nova-compute[71325]: No targets found.
Apr 13 21:56:31 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:56:31 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:56:31 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586,backing_fmt=raw /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk 1073741824" returned: 0 in 0.066s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "831d13e04670a700e34bb7ca13422d6bb43eb586" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5290b95d-107d-44b0-9915-078463a0c189]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7395cd19-c958-4d38-8eea-ad2e507a386e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:56:31 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:56:31 user nova-compute[71325]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)
Apr 13 21:56:31 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:56:31 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:56:31 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:56:31 user nova-compute[71325]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 (non-flash)
Apr 13 21:56:31 user nova-compute[71325]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)
Apr 13 21:56:31 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:56:31 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:56:31 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7dcee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d9ea7c-167b-4e82-aed7-10394afbd776]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fbbcf1-85f5-4778-b67d-a9bd57a24f39]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586 --force-share --output=json" returned: 0 in 0.174s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG nova.objects.instance [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'migration_context' on Instance uuid 2d1990a1-40ec-4c02-941f-813c22e8cd8f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:56:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdaff8b-e66d-49f5-943d-fe32c7225f50]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:56:32 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Rebasing disk image.
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c6bc2f-1dd5-44c8-b9d3-c501421c8b02]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d57ab46-baee-4b71-a319-5851f453fd71]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b49e0e-add8-478e-913e-babab2c0dc2f]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4, portal: 172.16.0.220,3260]
Apr 13 21:56:32 user nova-compute[71325]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4, portal: 172.16.0.220,3260] successful.
Apr 13 21:56:32 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.183s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 -F raw /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[52003d8c-2b8d-4408-a8b5-823d6d90eb72]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.554s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] <== disconnect_volume: return (558ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG nova.network.neutron [req-009b4e31-ca0f-47fc-83a6-0ea32b139981 req-3eca514f-81a7-4885-bff1-9b420a65e875 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Updated VIF entry in instance network info cache for port 0150fcfb-793e-4d51-966c-c30195a9802f. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG nova.network.neutron [req-009b4e31-ca0f-47fc-83a6-0ea32b139981 req-3eca514f-81a7-4885-bff1-9b420a65e875 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Updating instance_info_cache with network_info: [{"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:56:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-009b4e31-ca0f-47fc-83a6-0ea32b139981 req-3eca514f-81a7-4885-bff1-9b420a65e875 service nova] Releasing lock "refresh_cache-03554793-01dd-4629-97c7-b640f5934639" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:56:33 user nova-compute[71325]: DEBUG nova.objects.instance [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'flavor' on Instance uuid 03554793-01dd-4629-97c7-b640f5934639 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:56:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "03554793-01dd-4629-97c7-b640f5934639" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.530s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 -F raw /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk" returned: 0 in 2.106s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Ensure instance console log exists: /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Start _get_guest_xml network_info=[{"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ac7f1dcf989b528ba5cceb4c4d094a3d',container_format='bare',created_at=2023-04-13T21:54:36Z,direct_url=<?>,disk_format='qcow2',id=f514bce4-97a1-4dc6-b168-c629de2da778,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1709500779-shelved',owner='73c23bc3e8b14441b4622095502b5dae',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T21:54:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:56:34 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:56:34 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ac7f1dcf989b528ba5cceb4c4d094a3d',container_format='bare',created_at=2023-04-13T21:54:36Z,direct_url=<?>,disk_format='qcow2',id=f514bce4-97a1-4dc6-b168-c629de2da778,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1709500779-shelved',owner='73c23bc3e8b14441b4622095502b5dae',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T21:54:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.objects.instance [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2d1990a1-40ec-4c02-941f-813c22e8cd8f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1709500779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1709500779',id=21,image_ref='f514bce4-97a1-4dc6-b168-c629de2da778',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1268128451',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='73c23bc3e8b14441b4622095502b5dae',ramdisk_id='',reservation_id='r-j68sz1ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-710815470',owner_user_name='tempest-AttachVolumeShelveTestJSON-710815470-project-member',shelved_at='2023-04-13T21:54:39.803689',shelved_host='user',shelved_image_id='f514bce4-97a1-4dc6-b168-c629de2da778'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:56:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f151b673e3d47acb9c3ed9b9ecaf687',uuid=2d1990a1-40ec-4c02-941f-813c22e8cd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converting VIF {"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:f3,bridge_name='br-int',has_traffic_filtering=True,id=596fdd61-68e0-4968-9d6a-e70d32a61ea1,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596fdd61-68') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.objects.instance [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d1990a1-40ec-4c02-941f-813c22e8cd8f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:56:34 user nova-compute[71325]:   <uuid>2d1990a1-40ec-4c02-941f-813c22e8cd8f</uuid>
Apr 13 21:56:34 user nova-compute[71325]:   <name>instance-00000015</name>
Apr 13 21:56:34 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:56:34 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:56:34 user nova-compute[71325]:   <metadata>
Apr 13 21:56:34 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:56:34 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:56:34 user nova-compute[71325]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1709500779</nova:name>
Apr 13 21:56:34 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:56:34</nova:creationTime>
Apr 13 21:56:34 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:56:34 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:56:34 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:56:34 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:56:34 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:56:34 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:56:34 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:56:34 user nova-compute[71325]:       <nova:owner>
Apr 13 21:56:34 user nova-compute[71325]:         <nova:user uuid="3f151b673e3d47acb9c3ed9b9ecaf687">tempest-AttachVolumeShelveTestJSON-710815470-project-member</nova:user>
Apr 13 21:56:34 user nova-compute[71325]:         <nova:project uuid="73c23bc3e8b14441b4622095502b5dae">tempest-AttachVolumeShelveTestJSON-710815470</nova:project>
Apr 13 21:56:34 user nova-compute[71325]:       </nova:owner>
Apr 13 21:56:34 user nova-compute[71325]:       <nova:root type="image" uuid="f514bce4-97a1-4dc6-b168-c629de2da778"/>
Apr 13 21:56:34 user nova-compute[71325]:       <nova:ports>
Apr 13 21:56:34 user nova-compute[71325]:         <nova:port uuid="596fdd61-68e0-4968-9d6a-e70d32a61ea1">
Apr 13 21:56:34 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 21:56:34 user nova-compute[71325]:         </nova:port>
Apr 13 21:56:34 user nova-compute[71325]:       </nova:ports>
Apr 13 21:56:34 user nova-compute[71325]:     </nova:instance>
Apr 13 21:56:34 user nova-compute[71325]:   </metadata>
Apr 13 21:56:34 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:56:34 user nova-compute[71325]:     <system>
Apr 13 21:56:34 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:56:34 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:56:34 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:56:34 user nova-compute[71325]:       <entry name="serial">2d1990a1-40ec-4c02-941f-813c22e8cd8f</entry>
Apr 13 21:56:34 user nova-compute[71325]:       <entry name="uuid">2d1990a1-40ec-4c02-941f-813c22e8cd8f</entry>
Apr 13 21:56:34 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:56:34 user nova-compute[71325]:     </system>
Apr 13 21:56:34 user nova-compute[71325]:   </sysinfo>
Apr 13 21:56:34 user nova-compute[71325]:   <os>
Apr 13 21:56:34 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:56:34 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:56:34 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:56:34 user nova-compute[71325]:   </os>
Apr 13 21:56:34 user nova-compute[71325]:   <features>
Apr 13 21:56:34 user nova-compute[71325]:     <acpi/>
Apr 13 21:56:34 user nova-compute[71325]:     <apic/>
Apr 13 21:56:34 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:56:34 user nova-compute[71325]:   </features>
Apr 13 21:56:34 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:56:34 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:56:34 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:56:34 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:56:34 user nova-compute[71325]:   </clock>
Apr 13 21:56:34 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:56:34 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:56:34 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:56:34 user nova-compute[71325]:   </cpu>
Apr 13 21:56:34 user nova-compute[71325]:   <devices>
Apr 13 21:56:34 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:56:34 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:56:34 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk"/>
Apr 13 21:56:34 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:56:34 user nova-compute[71325]:     </disk>
Apr 13 21:56:34 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:56:34 user nova-compute[71325]:       <mac address="fa:16:3e:38:35:f3"/>
Apr 13 21:56:34 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:56:34 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:56:34 user nova-compute[71325]:       <target dev="tap596fdd61-68"/>
Apr 13 21:56:34 user nova-compute[71325]:     </interface>
Apr 13 21:56:34 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:56:34 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/console.log" append="off"/>
Apr 13 21:56:34 user nova-compute[71325]:     </serial>
Apr 13 21:56:34 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:56:34 user nova-compute[71325]:     <video>
Apr 13 21:56:34 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:56:34 user nova-compute[71325]:     </video>
Apr 13 21:56:34 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:56:34 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:56:34 user nova-compute[71325]:     </rng>
Apr 13 21:56:34 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:56:34 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:56:34 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:56:34 user nova-compute[71325]:     </memballoon>
Apr 13 21:56:34 user nova-compute[71325]:   </devices>
Apr 13 21:56:34 user nova-compute[71325]: </domain>
Apr 13 21:56:34 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1709500779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1709500779',id=21,image_ref='f514bce4-97a1-4dc6-b168-c629de2da778',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1268128451',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='73c23bc3e8b14441b4622095502b5dae',ramdisk_id='',reservation_id='r-j68sz1ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-710815470',owner_user_name='tempest-AttachVolumeShelveTestJSON-710815470-project-member',shelved_at='2023-04-13T21:54:39.803689',shelved_host='user',shelved_image_id='f514bce4-97a1-4dc6-b168-c629de2da778'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:56:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f151b673e3d47acb9c3ed9b9ecaf687',uuid=2d1990a1-40ec-4c02-941f-813c22e8cd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converting VIF {"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:f3,bridge_name='br-int',has_traffic_filtering=True,id=596fdd61-68e0-4968-9d6a-e70d32a61ea1,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596fdd61-68') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG os_vif [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:f3,bridge_name='br-int',has_traffic_filtering=True,id=596fdd61-68e0-4968-9d6a-e70d32a61ea1,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596fdd61-68') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap596fdd61-68, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap596fdd61-68, col_values=(('external_ids', {'iface-id': '596fdd61-68e0-4968-9d6a-e70d32a61ea1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:35:f3', 'vm-uuid': '2d1990a1-40ec-4c02-941f-813c22e8cd8f'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:34 user nova-compute[71325]: INFO os_vif [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:f3,bridge_name='br-int',has_traffic_filtering=True,id=596fdd61-68e0-4968-9d6a-e70d32a61ea1,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596fdd61-68')
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:56:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] No VIF found with MAC fa:16:3e:38:35:f3, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:56:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-4f6f616e-fa43-4b5e-bd8b-0960433dc717 req-4b05d765-bec5-4251-82ae-85f1008f9b2e service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received event network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:56:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4f6f616e-fa43-4b5e-bd8b-0960433dc717 req-4b05d765-bec5-4251-82ae-85f1008f9b2e service nova] Acquiring lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4f6f616e-fa43-4b5e-bd8b-0960433dc717 req-4b05d765-bec5-4251-82ae-85f1008f9b2e service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4f6f616e-fa43-4b5e-bd8b-0960433dc717 req-4b05d765-bec5-4251-82ae-85f1008f9b2e service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-4f6f616e-fa43-4b5e-bd8b-0960433dc717 req-4b05d765-bec5-4251-82ae-85f1008f9b2e service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] No waiting events found dispatching network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:56:36 user nova-compute[71325]: WARNING nova.compute.manager [req-4f6f616e-fa43-4b5e-bd8b-0960433dc717 req-4b05d765-bec5-4251-82ae-85f1008f9b2e service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received unexpected event network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 21:56:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:38 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422998.0443933, 2d1990a1-40ec-4c02-941f-813c22e8cd8f => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:56:38 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] VM Resumed (Lifecycle Event)
Apr 13 21:56:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:56:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:56:38 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Instance spawned successfully.
Apr 13 21:56:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:56:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:56:38 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:56:38 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681422998.0457451, 2d1990a1-40ec-4c02-941f-813c22e8cd8f => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:56:38 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] VM Started (Lifecycle Event)
Apr 13 21:56:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:56:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:56:38 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:56:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-377139eb-7bc4-4526-ae63-835a94e81873 req-c239ba5c-0346-405e-ab38-8ca0929182d7 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received event network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:56:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-377139eb-7bc4-4526-ae63-835a94e81873 req-c239ba5c-0346-405e-ab38-8ca0929182d7 service nova] Acquiring lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-377139eb-7bc4-4526-ae63-835a94e81873 req-c239ba5c-0346-405e-ab38-8ca0929182d7 service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-377139eb-7bc4-4526-ae63-835a94e81873 req-c239ba5c-0346-405e-ab38-8ca0929182d7 service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-377139eb-7bc4-4526-ae63-835a94e81873 req-c239ba5c-0346-405e-ab38-8ca0929182d7 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] No waiting events found dispatching network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:56:38 user nova-compute[71325]: WARNING nova.compute.manager [req-377139eb-7bc4-4526-ae63-835a94e81873 req-c239ba5c-0346-405e-ab38-8ca0929182d7 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received unexpected event network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 21:56:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:56:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.173s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:56:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:56:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:56:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:56:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:51 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:56:52 user nova-compute[71325]: INFO nova.compute.claims [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Claim successful on node user
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Refreshing inventories for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Updating ProviderTree inventory for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Updating inventory in ProviderTree for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Refreshing aggregate associations for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55, aggregates: None {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Refreshing trait associations for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:56:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.policy [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fe6b951236f4a96a2ac12a5dea4602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd2e9bf0c5345f6bd3f030fb9f55e03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:56:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Creating image(s)
Apr 13 21:56:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "/opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "/opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.131s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk 1073741824" returned: 0 in 0.050s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.133s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Cannot resize image /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lazy-loading 'migration_context' on Instance uuid ef8a447a-cdcd-4a56-ad53-abe6d9951266 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Ensure instance console log exists: /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:53 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Successfully created port: 24413127-af01-4371-9639-0f41979b91fb {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Successfully updated port: 24413127-af01-4371-9639-0f41979b91fb {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "refresh_cache-ef8a447a-cdcd-4a56-ad53-abe6d9951266" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquired lock "refresh_cache-ef8a447a-cdcd-4a56-ad53-abe6d9951266" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-7c884532-6535-4289-893c-b60389d4415e req-14b2090b-564e-4570-87e4-c7c3e6d97419 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Received event network-changed-24413127-af01-4371-9639-0f41979b91fb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-7c884532-6535-4289-893c-b60389d4415e req-14b2090b-564e-4570-87e4-c7c3e6d97419 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Refreshing instance network info cache due to event network-changed-24413127-af01-4371-9639-0f41979b91fb. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7c884532-6535-4289-893c-b60389d4415e req-14b2090b-564e-4570-87e4-c7c3e6d97419 service nova] Acquiring lock "refresh_cache-ef8a447a-cdcd-4a56-ad53-abe6d9951266" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Updating instance_info_cache with network_info: [{"id": "24413127-af01-4371-9639-0f41979b91fb", "address": "fa:16:3e:77:6b:3e", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24413127-af", "ovs_interfaceid": "24413127-af01-4371-9639-0f41979b91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Releasing lock "refresh_cache-ef8a447a-cdcd-4a56-ad53-abe6d9951266" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Instance network_info: |[{"id": "24413127-af01-4371-9639-0f41979b91fb", "address": "fa:16:3e:77:6b:3e", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24413127-af", "ovs_interfaceid": "24413127-af01-4371-9639-0f41979b91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7c884532-6535-4289-893c-b60389d4415e req-14b2090b-564e-4570-87e4-c7c3e6d97419 service nova] Acquired lock "refresh_cache-ef8a447a-cdcd-4a56-ad53-abe6d9951266" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.network.neutron [req-7c884532-6535-4289-893c-b60389d4415e req-14b2090b-564e-4570-87e4-c7c3e6d97419 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Refreshing network info cache for port 24413127-af01-4371-9639-0f41979b91fb {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Start _get_guest_xml network_info=[{"id": "24413127-af01-4371-9639-0f41979b91fb", "address": "fa:16:3e:77:6b:3e", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24413127-af", "ovs_interfaceid": "24413127-af01-4371-9639-0f41979b91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:56:54 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:56:54 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2002337095',display_name='tempest-VolumesActionsTest-instance-2002337095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2002337095',id=28,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efd2e9bf0c5345f6bd3f030fb9f55e03',ramdisk_id='',reservation_id='r-zh9jq7lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1838938247',owner_user_name='tempest-VolumesActionsTest-1838938247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:56:53Z,user_data=None,user_id='9fe6b951236f4a96a2ac12a5dea4602a',uuid=ef8a447a-cdcd-4a56-ad53-abe6d9951266,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24413127-af01-4371-9639-0f41979b91fb", "address": "fa:16:3e:77:6b:3e", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24413127-af", "ovs_interfaceid": "24413127-af01-4371-9639-0f41979b91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Converting VIF {"id": "24413127-af01-4371-9639-0f41979b91fb", "address": "fa:16:3e:77:6b:3e", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24413127-af", "ovs_interfaceid": "24413127-af01-4371-9639-0f41979b91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:6b:3e,bridge_name='br-int',has_traffic_filtering=True,id=24413127-af01-4371-9639-0f41979b91fb,network=Network(dd758252-0db3-4d47-a231-c8a85e067e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24413127-af') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lazy-loading 'pci_devices' on Instance uuid ef8a447a-cdcd-4a56-ad53-abe6d9951266 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:56:54 user nova-compute[71325]:   <uuid>ef8a447a-cdcd-4a56-ad53-abe6d9951266</uuid>
Apr 13 21:56:54 user nova-compute[71325]:   <name>instance-0000001c</name>
Apr 13 21:56:54 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:56:54 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:56:54 user nova-compute[71325]:   <metadata>
Apr 13 21:56:54 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:56:54 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:56:54 user nova-compute[71325]:       <nova:name>tempest-VolumesActionsTest-instance-2002337095</nova:name>
Apr 13 21:56:54 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:56:54</nova:creationTime>
Apr 13 21:56:54 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:56:54 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:56:54 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:56:54 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:56:54 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:56:54 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:56:54 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:56:54 user nova-compute[71325]:       <nova:owner>
Apr 13 21:56:54 user nova-compute[71325]:         <nova:user uuid="9fe6b951236f4a96a2ac12a5dea4602a">tempest-VolumesActionsTest-1838938247-project-member</nova:user>
Apr 13 21:56:54 user nova-compute[71325]:         <nova:project uuid="efd2e9bf0c5345f6bd3f030fb9f55e03">tempest-VolumesActionsTest-1838938247</nova:project>
Apr 13 21:56:54 user nova-compute[71325]:       </nova:owner>
Apr 13 21:56:54 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:56:54 user nova-compute[71325]:       <nova:ports>
Apr 13 21:56:54 user nova-compute[71325]:         <nova:port uuid="24413127-af01-4371-9639-0f41979b91fb">
Apr 13 21:56:54 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 21:56:54 user nova-compute[71325]:         </nova:port>
Apr 13 21:56:54 user nova-compute[71325]:       </nova:ports>
Apr 13 21:56:54 user nova-compute[71325]:     </nova:instance>
Apr 13 21:56:54 user nova-compute[71325]:   </metadata>
Apr 13 21:56:54 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:56:54 user nova-compute[71325]:     <system>
Apr 13 21:56:54 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:56:54 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:56:54 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:56:54 user nova-compute[71325]:       <entry name="serial">ef8a447a-cdcd-4a56-ad53-abe6d9951266</entry>
Apr 13 21:56:54 user nova-compute[71325]:       <entry name="uuid">ef8a447a-cdcd-4a56-ad53-abe6d9951266</entry>
Apr 13 21:56:54 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:56:54 user nova-compute[71325]:     </system>
Apr 13 21:56:54 user nova-compute[71325]:   </sysinfo>
Apr 13 21:56:54 user nova-compute[71325]:   <os>
Apr 13 21:56:54 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:56:54 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:56:54 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:56:54 user nova-compute[71325]:   </os>
Apr 13 21:56:54 user nova-compute[71325]:   <features>
Apr 13 21:56:54 user nova-compute[71325]:     <acpi/>
Apr 13 21:56:54 user nova-compute[71325]:     <apic/>
Apr 13 21:56:54 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:56:54 user nova-compute[71325]:   </features>
Apr 13 21:56:54 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:56:54 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:56:54 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:56:54 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:56:54 user nova-compute[71325]:   </clock>
Apr 13 21:56:54 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:56:54 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:56:54 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:56:54 user nova-compute[71325]:   </cpu>
Apr 13 21:56:54 user nova-compute[71325]:   <devices>
Apr 13 21:56:54 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:56:54 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:56:54 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk"/>
Apr 13 21:56:54 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:56:54 user nova-compute[71325]:     </disk>
Apr 13 21:56:54 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:56:54 user nova-compute[71325]:       <mac address="fa:16:3e:77:6b:3e"/>
Apr 13 21:56:54 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:56:54 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:56:54 user nova-compute[71325]:       <target dev="tap24413127-af"/>
Apr 13 21:56:54 user nova-compute[71325]:     </interface>
Apr 13 21:56:54 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:56:54 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/console.log" append="off"/>
Apr 13 21:56:54 user nova-compute[71325]:     </serial>
Apr 13 21:56:54 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:56:54 user nova-compute[71325]:     <video>
Apr 13 21:56:54 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:56:54 user nova-compute[71325]:     </video>
Apr 13 21:56:54 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:56:54 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:56:54 user nova-compute[71325]:     </rng>
Apr 13 21:56:54 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:56:54 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:56:54 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:56:54 user nova-compute[71325]:     </memballoon>
Apr 13 21:56:54 user nova-compute[71325]:   </devices>
Apr 13 21:56:54 user nova-compute[71325]: </domain>
Apr 13 21:56:54 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2002337095',display_name='tempest-VolumesActionsTest-instance-2002337095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2002337095',id=28,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efd2e9bf0c5345f6bd3f030fb9f55e03',ramdisk_id='',reservation_id='r-zh9jq7lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1838938247',owner_user_name='tempest-VolumesActionsTest-1838938247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:56:53Z,user_data=None,user_id='9fe6b951236f4a96a2ac12a5dea4602a',uuid=ef8a447a-cdcd-4a56-ad53-abe6d9951266,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24413127-af01-4371-9639-0f41979b91fb", "address": "fa:16:3e:77:6b:3e", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24413127-af", "ovs_interfaceid": "24413127-af01-4371-9639-0f41979b91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Converting VIF {"id": "24413127-af01-4371-9639-0f41979b91fb", "address": "fa:16:3e:77:6b:3e", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24413127-af", "ovs_interfaceid": "24413127-af01-4371-9639-0f41979b91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:6b:3e,bridge_name='br-int',has_traffic_filtering=True,id=24413127-af01-4371-9639-0f41979b91fb,network=Network(dd758252-0db3-4d47-a231-c8a85e067e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24413127-af') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG os_vif [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6b:3e,bridge_name='br-int',has_traffic_filtering=True,id=24413127-af01-4371-9639-0f41979b91fb,network=Network(dd758252-0db3-4d47-a231-c8a85e067e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24413127-af') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24413127-af, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap24413127-af, col_values=(('external_ids', {'iface-id': '24413127-af01-4371-9639-0f41979b91fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:6b:3e', 'vm-uuid': 'ef8a447a-cdcd-4a56-ad53-abe6d9951266'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:54 user nova-compute[71325]: INFO os_vif [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6b:3e,bridge_name='br-int',has_traffic_filtering=True,id=24413127-af01-4371-9639-0f41979b91fb,network=Network(dd758252-0db3-4d47-a231-c8a85e067e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24413127-af')
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:56:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] No VIF found with MAC fa:16:3e:77:6b:3e, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:56:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:55 user nova-compute[71325]: DEBUG nova.network.neutron [req-7c884532-6535-4289-893c-b60389d4415e req-14b2090b-564e-4570-87e4-c7c3e6d97419 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Updated VIF entry in instance network info cache for port 24413127-af01-4371-9639-0f41979b91fb. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:56:55 user nova-compute[71325]: DEBUG nova.network.neutron [req-7c884532-6535-4289-893c-b60389d4415e req-14b2090b-564e-4570-87e4-c7c3e6d97419 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Updating instance_info_cache with network_info: [{"id": "24413127-af01-4371-9639-0f41979b91fb", "address": "fa:16:3e:77:6b:3e", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24413127-af", "ovs_interfaceid": "24413127-af01-4371-9639-0f41979b91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:56:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7c884532-6535-4289-893c-b60389d4415e req-14b2090b-564e-4570-87e4-c7c3e6d97419 service nova] Releasing lock "refresh_cache-ef8a447a-cdcd-4a56-ad53-abe6d9951266" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:56:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:56:56 user nova-compute[71325]: DEBUG nova.compute.manager [req-c721e3f4-b4c5-4ba5-bdf4-09c5ecd7ae62 req-17fcbc44-c29e-418e-b3b5-fdffb9a331f1 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Received event network-vif-plugged-24413127-af01-4371-9639-0f41979b91fb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:56:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c721e3f4-b4c5-4ba5-bdf4-09c5ecd7ae62 req-17fcbc44-c29e-418e-b3b5-fdffb9a331f1 service nova] Acquiring lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c721e3f4-b4c5-4ba5-bdf4-09c5ecd7ae62 req-17fcbc44-c29e-418e-b3b5-fdffb9a331f1 service nova] Lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c721e3f4-b4c5-4ba5-bdf4-09c5ecd7ae62 req-17fcbc44-c29e-418e-b3b5-fdffb9a331f1 service nova] Lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:56 user nova-compute[71325]: DEBUG nova.compute.manager [req-c721e3f4-b4c5-4ba5-bdf4-09c5ecd7ae62 req-17fcbc44-c29e-418e-b3b5-fdffb9a331f1 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] No waiting events found dispatching network-vif-plugged-24413127-af01-4371-9639-0f41979b91fb {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:56:56 user nova-compute[71325]: WARNING nova.compute.manager [req-c721e3f4-b4c5-4ba5-bdf4-09c5ecd7ae62 req-17fcbc44-c29e-418e-b3b5-fdffb9a331f1 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Received unexpected event network-vif-plugged-24413127-af01-4371-9639-0f41979b91fb for instance with vm_state building and task_state spawning.
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423018.3071764, ef8a447a-cdcd-4a56-ad53-abe6d9951266 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:56:58 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] VM Resumed (Lifecycle Event)
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:56:58 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Instance spawned successfully.
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:56:58 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423018.3101573, ef8a447a-cdcd-4a56-ad53-abe6d9951266 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:56:58 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] VM Started (Lifecycle Event)
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:56:58 user nova-compute[71325]: INFO nova.compute.manager [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Took 5.54 seconds to spawn the instance on the hypervisor.
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:56:58 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-ef6296fe-88b1-4f55-bd98-75505e8c2a44 req-7a584f7c-4ed2-43d2-8560-d0ac763f3538 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Received event network-vif-plugged-24413127-af01-4371-9639-0f41979b91fb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:56:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ef6296fe-88b1-4f55-bd98-75505e8c2a44 req-7a584f7c-4ed2-43d2-8560-d0ac763f3538 service nova] Acquiring lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:56:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ef6296fe-88b1-4f55-bd98-75505e8c2a44 req-7a584f7c-4ed2-43d2-8560-d0ac763f3538 service nova] Lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:56:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ef6296fe-88b1-4f55-bd98-75505e8c2a44 req-7a584f7c-4ed2-43d2-8560-d0ac763f3538 service nova] Lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-ef6296fe-88b1-4f55-bd98-75505e8c2a44 req-7a584f7c-4ed2-43d2-8560-d0ac763f3538 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] No waiting events found dispatching network-vif-plugged-24413127-af01-4371-9639-0f41979b91fb {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:56:58 user nova-compute[71325]: WARNING nova.compute.manager [req-ef6296fe-88b1-4f55-bd98-75505e8c2a44 req-7a584f7c-4ed2-43d2-8560-d0ac763f3538 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Received unexpected event network-vif-plugged-24413127-af01-4371-9639-0f41979b91fb for instance with vm_state building and task_state spawning.
Apr 13 21:56:58 user nova-compute[71325]: INFO nova.compute.manager [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Took 6.50 seconds to build instance.
Apr 13 21:56:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.586s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:56:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:04 user nova-compute[71325]: DEBUG nova.objects.instance [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'flavor' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:05 user nova-compute[71325]: INFO nova.compute.manager [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Attaching volume 026beb94-6220-4541-8c6b-3296ae986d4a to /dev/vdb
Apr 13 21:57:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG os_brick.utils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[746bcb19-419c-4b2c-920b-a043ed8c3c44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8798862-0073-4f34-b1f0-185871cff607]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f10b95-e1c5-4df7-9d96-5d674b0395ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7aa913-0b32-42e6-8bd8-847d16397863]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:57:05 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:57:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f93c04-04f1-4a27-92af-99df8eb1e2a2]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG os_brick.utils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:57:05 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating existing volume attachment record: 5b501a71-53ad-4c3c-8f18-d5d7e0f9206a {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:57:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "64f496e7-47db-4602-850e-0260d5858049" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "64f496e7-47db-4602-850e-0260d5858049" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "64f496e7-47db-4602-850e-0260d5858049-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "64f496e7-47db-4602-850e-0260d5858049-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "64f496e7-47db-4602-850e-0260d5858049-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:06 user nova-compute[71325]: INFO nova.compute.manager [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Terminating instance
Apr 13 21:57:06 user nova-compute[71325]: DEBUG nova.compute.manager [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:57:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG nova.compute.manager [req-4b2cce06-8bc0-4712-bd8d-2ec7f505889b req-9048f3c1-8565-4c4a-bcb2-80dea448edbf service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] Received event network-vif-unplugged-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4b2cce06-8bc0-4712-bd8d-2ec7f505889b req-9048f3c1-8565-4c4a-bcb2-80dea448edbf service nova] Acquiring lock "64f496e7-47db-4602-850e-0260d5858049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4b2cce06-8bc0-4712-bd8d-2ec7f505889b req-9048f3c1-8565-4c4a-bcb2-80dea448edbf service nova] Lock "64f496e7-47db-4602-850e-0260d5858049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4b2cce06-8bc0-4712-bd8d-2ec7f505889b req-9048f3c1-8565-4c4a-bcb2-80dea448edbf service nova] Lock "64f496e7-47db-4602-850e-0260d5858049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG nova.compute.manager [req-4b2cce06-8bc0-4712-bd8d-2ec7f505889b req-9048f3c1-8565-4c4a-bcb2-80dea448edbf service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] No waiting events found dispatching network-vif-unplugged-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG nova.compute.manager [req-4b2cce06-8bc0-4712-bd8d-2ec7f505889b req-9048f3c1-8565-4c4a-bcb2-80dea448edbf service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] Received event network-vif-unplugged-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:57:07 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 64f496e7-47db-4602-850e-0260d5858049] Instance destroyed successfully.
Apr 13 21:57:07 user nova-compute[71325]: DEBUG nova.objects.instance [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lazy-loading 'resources' on Instance uuid 64f496e7-47db-4602-850e-0260d5858049 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1202537126',display_name='tempest-TestVolumeBootPattern-server-1202537126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1202537126',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:55:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-5dhza4ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:55:33Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=64f496e7-47db-4602-850e-0260d5858049,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "address": "fa:16:3e:0c:06:ae", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd2a5c6-f7", "ovs_interfaceid": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "address": "fa:16:3e:0c:06:ae", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd2a5c6-f7", "ovs_interfaceid": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:ae,bridge_name='br-int',has_traffic_filtering=True,id=7dd2a5c6-f76c-45f3-adf1-8e92fa15d479,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd2a5c6-f7') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_vif [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:ae,bridge_name='br-int',has_traffic_filtering=True,id=7dd2a5c6-f76c-45f3-adf1-8e92fa15d479,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd2a5c6-f7') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7dd2a5c6-f7, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:07 user nova-compute[71325]: INFO os_vif [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:ae,bridge_name='br-int',has_traffic_filtering=True,id=7dd2a5c6-f76c-45f3-adf1-8e92fa15d479,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd2a5c6-f7')
Apr 13 21:57:07 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRmrYWQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:57:07 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b59c5c-1332-4bb5-854d-91a07ef6630d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:57:07 user nova-compute[71325]: No targets found.
Apr 13 21:57:07 user nova-compute[71325]: iSNS:
Apr 13 21:57:07 user nova-compute[71325]: No targets found.
Apr 13 21:57:07 user nova-compute[71325]: STATIC:
Apr 13 21:57:07 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41
Apr 13 21:57:07 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:07 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:07 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:57:07 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:07 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:07 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808
Apr 13 21:57:07 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:07 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:07 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4
Apr 13 21:57:07 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:07 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:07 user nova-compute[71325]: FIRMWARE:
Apr 13 21:57:07 user nova-compute[71325]: No targets found.
Apr 13 21:57:07 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:57:07 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:57:07 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aead271-5b58-4a5d-ab59-e3f10e1ca45a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b93763c-1a56-4c8c-9a89-3b110417eea3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:07 user nova-compute[71325]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)
Apr 13 21:57:07 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:07 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:07 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:07 user nova-compute[71325]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 (non-flash)
Apr 13 21:57:07 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:07 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:07 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c41a9bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41'): ({'sdc'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Removing single pathed devices sdc {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbfc875-e170-4157-8169-823428dd6bde]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a382aa-7be6-43ed-bf4c-fdb7df067460]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flushing IO for device /dev/sdc {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[000d10d9-fa14-433c-a7a2-a3e991935733]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c811cd-f5a1-44a2-a81a-fcdb9c7f04e8]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[93db8581-b494-44ab-a533-e1138fdc953d]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:07 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:08 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce57f86-8f1e-472f-af02-f10df0b7ef16]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:08 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41, portal: 172.16.0.220,3260]
Apr 13 21:57:08 user nova-compute[71325]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41, portal: 172.16.0.220,3260] successful.
Apr 13 21:57:08 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c71ae3e-d70a-4cb3-b997-8270a4b05b41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:08 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[92da4d6c-cedb-4279-b22b-e3dfb29c5a17]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:08 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:08 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:57:08 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== disconnect_volume: return (361ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:57:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:57:08 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Deleting instance files /opt/stack/data/nova/instances/64f496e7-47db-4602-850e-0260d5858049_del
Apr 13 21:57:08 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Deletion of /opt/stack/data/nova/instances/64f496e7-47db-4602-850e-0260d5858049_del complete
Apr 13 21:57:08 user nova-compute[71325]: INFO nova.compute.manager [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Took 1.25 seconds to destroy the instance on the hypervisor.
Apr 13 21:57:08 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:57:08 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 64f496e7-47db-4602-850e-0260d5858049] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:57:08 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 64f496e7-47db-4602-850e-0260d5858049] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:57:08 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 64f496e7-47db-4602-850e-0260d5858049] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:57:08 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 64f496e7-47db-4602-850e-0260d5858049] Took 0.50 seconds to deallocate network for instance.
Apr 13 21:57:08 user nova-compute[71325]: DEBUG nova.compute.manager [req-3a3c84d3-70d0-46eb-8a1b-fc72169fa4a4 req-18ddb546-8875-474a-bb97-7bb70ef6ddf6 service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] Received event network-vif-deleted-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG nova.compute.manager [req-6c15f619-ea33-44ac-874d-c2b696687076 req-f0054e8b-7739-414d-8d7a-509441a744cf service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] Received event network-vif-plugged-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6c15f619-ea33-44ac-874d-c2b696687076 req-f0054e8b-7739-414d-8d7a-509441a744cf service nova] Acquiring lock "64f496e7-47db-4602-850e-0260d5858049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6c15f619-ea33-44ac-874d-c2b696687076 req-f0054e8b-7739-414d-8d7a-509441a744cf service nova] Lock "64f496e7-47db-4602-850e-0260d5858049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-6c15f619-ea33-44ac-874d-c2b696687076 req-f0054e8b-7739-414d-8d7a-509441a744cf service nova] Lock "64f496e7-47db-4602-850e-0260d5858049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG nova.compute.manager [req-6c15f619-ea33-44ac-874d-c2b696687076 req-f0054e8b-7739-414d-8d7a-509441a744cf service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] No waiting events found dispatching network-vif-plugged-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:09 user nova-compute[71325]: WARNING nova.compute.manager [req-6c15f619-ea33-44ac-874d-c2b696687076 req-f0054e8b-7739-414d-8d7a-509441a744cf service nova] [instance: 64f496e7-47db-4602-850e-0260d5858049] Received unexpected event network-vif-plugged-7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 for instance with vm_state active and task_state deleting.
Apr 13 21:57:09 user nova-compute[71325]: INFO nova.compute.manager [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Took 0.85 seconds to detach 1 volumes for instance.
Apr 13 21:57:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Deleting volume: 2c71ae3e-d70a-4cb3-b997-8270a4b05b41 {{(pid=71325) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBajDAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:57:09 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:57:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:57:09 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:57:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:57:09 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c87ba20-0b69-4e03-b3b9-186e1ec428e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:57:09 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac901fc-bce8-4c4a-938e-c0cc654628d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a] added
Apr 13 21:57:09 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d823afa6-ac9f-4034-9c26-7a8f7987f2dd]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c7eb2c-0e34-458d-89b4-6113724f9802]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBajDAYp {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBajDAYp" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d26137-1c22-4bff-b132-17cf11c30000]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XBajDAYp'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[950ec139-ac75-4425-ba99-40096b1fa4c6]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[807dfa04-fd2a-4ed0-8010-eee0e358298a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:10 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:10 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:10 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:10 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb230ab-a316-45cb-8a53-9d5507ab6cc2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260]
Apr 13 21:57:10 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260] successful.
Apr 13 21:57:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb4a46b-819b-46a3-ae13-64d23f18bffd]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:10 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Deleted allocations for instance 64f496e7-47db-4602-850e-0260d5858049
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9180ce49-9e14-4075-ad65-4bf92e83eb80]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:10 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:10 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:10 user nova-compute[71325]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:10 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:10 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:10 user nova-compute[71325]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf823afb-d05b-4845-b446-22a3038e76ff]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBajDAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "64f496e7-47db-4602-850e-0260d5858049" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.325s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:57:10 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:57:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:57:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23432336236313934', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:57:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432336236313934', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:57:11 user nova-compute[71325]: DEBUG nova.objects.instance [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'flavor' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:57:11 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:57:11 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 21:57:11 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:57:11 user nova-compute[71325]:   <serial>026beb94-6220-4541-8c6b-3296ae986d4a</serial>
Apr 13 21:57:11 user nova-compute[71325]: </disk>
Apr 13 21:57:11 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:57:11 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Updating instance_info_cache with network_info: [{"id": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "address": "fa:16:3e:c3:11:10", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922fdd9d-6e", "ovs_interfaceid": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:57:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:57:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:57:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:57:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:57:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No VIF found with MAC fa:16:3e:ef:31:9d, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:57:11 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:57:11 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:57:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.744s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:12 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:57:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:57:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Stashing vm_state: active {{(pid=71325) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG nova.objects.instance [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'pci_requests' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:57:13 user nova-compute[71325]: INFO nova.compute.claims [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Claim successful on node user
Apr 13 21:57:13 user nova-compute[71325]: DEBUG nova.objects.instance [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'resources' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG nova.objects.instance [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'pci_devices' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:14 user nova-compute[71325]: INFO nova.compute.resource_tracker [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating resource usage from migration 3ddfcd30-8fec-4291-95d8-7d3f164519d4
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.804s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:14 user nova-compute[71325]: INFO nova.compute.manager [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Migrating
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:57:14 user nova-compute[71325]: INFO nova.compute.rpcapi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquired lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG nova.network.neutron [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating instance_info_cache with network_info: [{"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Releasing lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Starting migrate_disk_and_power_off {{(pid=71325) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-a0e4a080-140a-408a-ad54-cdd2edfde8a9 req-76feae38-a3b0-4ce2-a2df-5e35da602019 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-unplugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a0e4a080-140a-408a-ad54-cdd2edfde8a9 req-76feae38-a3b0-4ce2-a2df-5e35da602019 service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a0e4a080-140a-408a-ad54-cdd2edfde8a9 req-76feae38-a3b0-4ce2-a2df-5e35da602019 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a0e4a080-140a-408a-ad54-cdd2edfde8a9 req-76feae38-a3b0-4ce2-a2df-5e35da602019 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-a0e4a080-140a-408a-ad54-cdd2edfde8a9 req-76feae38-a3b0-4ce2-a2df-5e35da602019 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-unplugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:15 user nova-compute[71325]: WARNING nova.compute.manager [req-a0e4a080-140a-408a-ad54-cdd2edfde8a9 req-76feae38-a3b0-4ce2-a2df-5e35da602019 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-unplugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state active and task_state resize_migrating.
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:16 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance destroyed successfully.
Apr 13 21:57:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-968149372',display_name='tempest-ServerActionsTestJSON-server-1348347503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-968149372',id=14,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-p35kb61w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:57:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=c895d9cf-e6c1-42d6-88e3-1209b203fbe3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1784901700-network", "vif_mac": "fa:16:3e:ef:31:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1784901700-network", "vif_mac": "fa:16:3e:ef:31:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_vif [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03480082-c2, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:57:16 user nova-compute[71325]: INFO os_vif [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2')
Apr 13 21:57:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBajDAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:57:16 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[674348d6-a532-48d7-9640-0e9dca8b9d2e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:57:16 user nova-compute[71325]: No targets found.
Apr 13 21:57:16 user nova-compute[71325]: iSNS:
Apr 13 21:57:16 user nova-compute[71325]: No targets found.
Apr 13 21:57:16 user nova-compute[71325]: STATIC:
Apr 13 21:57:16 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a
Apr 13 21:57:16 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:16 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:16 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:57:16 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:16 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:16 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808
Apr 13 21:57:16 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:16 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:16 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4
Apr 13 21:57:16 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:16 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:16 user nova-compute[71325]: FIRMWARE:
Apr 13 21:57:16 user nova-compute[71325]: No targets found.
Apr 13 21:57:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:57:16 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:57:16 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[90059f1c-9774-4493-989f-4fdbd5d56584]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbad6609-43ca-44b6-8e41-ed25cad0655a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:16 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:16 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:16 user nova-compute[71325]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:16 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:16 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:16 user nova-compute[71325]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7e1dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea24e31-a10b-4243-9503-219ecc69f625]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3fb783-3463-4975-91bf-9e2856495201]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1dbe0c-9f65-4f52-b317-cb2cfd670fe4]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee1b546-0ed6-40b5-befc-b3b09f3039df]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6070c158-a4e2-4244-9ff6-41cd5d862234]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b137f3f-b210-4c3a-bdda-5b36b789a077]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260]
Apr 13 21:57:17 user nova-compute[71325]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260] successful.
Apr 13 21:57:17 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:17 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:57:17 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7459MB free_disk=26.046730041503906GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3cbce5-400e-4e39-9363-f037874a927c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.722s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== disconnect_volume: return (725ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Applying migration context for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 as it has an incoming, in-progress migration 3ddfcd30-8fec-4291-95d8-7d3f164519d4. Migration status is migrating {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 21:57:17 user nova-compute[71325]: INFO nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating resource usage from migration 3ddfcd30-8fec-4291-95d8-7d3f164519d4
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 03554793-01dd-4629-97c7-b640f5934639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ef8a447a-cdcd-4a56-ad53-abe6d9951266 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Migration 3ddfcd30-8fec-4291-95d8-7d3f164519d4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=2240MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3_resize/disk /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "cp -r /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3_resize/disk /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk" returned: 0 in 0.260s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3_resize/disk.info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk.info {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "cp -r /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3_resize/disk.info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk.info" returned: 0 in 0.044s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.727s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-40175d6b-4d2b-470c-b297-39604f945133 req-1a197fb8-f86b-4433-b750-2220c7ecfd5d service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-40175d6b-4d2b-470c-b297-39604f945133 req-1a197fb8-f86b-4433-b750-2220c7ecfd5d service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-40175d6b-4d2b-470c-b297-39604f945133 req-1a197fb8-f86b-4433-b750-2220c7ecfd5d service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-40175d6b-4d2b-470c-b297-39604f945133 req-1a197fb8-f86b-4433-b750-2220c7ecfd5d service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-40175d6b-4d2b-470c-b297-39604f945133 req-1a197fb8-f86b-4433-b750-2220c7ecfd5d service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:17 user nova-compute[71325]: WARNING nova.compute.manager [req-40175d6b-4d2b-470c-b297-39604f945133 req-1a197fb8-f86b-4433-b750-2220c7ecfd5d service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state active and task_state resize_migrating.
Apr 13 21:57:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Port 03480082-c22f-4ad9-bc15-d536f115ec88 binding to destination host user is already ACTIVE {{(pid=71325) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 21:57:18 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:57:18 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:57:18 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:57:18 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:57:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:57:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquired lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:57:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG nova.network.neutron [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating instance_info_cache with network_info: [{"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Releasing lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG os_brick.utils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[673f2e31-4bd9-4aac-9b50-87c7f74cb0c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d0d852-f4ac-4c9f-8a84-ba3dbfe7fa1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f511a451-b467-4f1b-9e32-c7a58884554a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9d5f41-3421-4377-8992-a264614cd5a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:57:19 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:57:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bf5218-0760-4765-b865-fbe524598bb9]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:57:19 user nova-compute[71325]: DEBUG os_brick.utils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:57:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:22 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423027.6965153, 64f496e7-47db-4602-850e-0260d5858049 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:57:22 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 64f496e7-47db-4602-850e-0260d5858049] VM Stopped (Lifecycle Event)
Apr 13 21:57:22 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b00db7f9-e6b9-4a61-a475-7d0d684f77bc None None] [instance: 64f496e7-47db-4602-850e-0260d5858049] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "03554793-01dd-4629-97c7-b640f5934639" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "03554793-01dd-4629-97c7-b640f5934639-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "03554793-01dd-4629-97c7-b640f5934639-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:23 user nova-compute[71325]: INFO nova.compute.manager [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Terminating instance
Apr 13 21:57:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG nova.compute.manager [req-4fb0c151-7c53-4015-9320-6592edbe5b98 req-9d269b7a-731e-4367-b9f3-a207b3f8fb7a service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-vif-unplugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4fb0c151-7c53-4015-9320-6592edbe5b98 req-9d269b7a-731e-4367-b9f3-a207b3f8fb7a service nova] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4fb0c151-7c53-4015-9320-6592edbe5b98 req-9d269b7a-731e-4367-b9f3-a207b3f8fb7a service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4fb0c151-7c53-4015-9320-6592edbe5b98 req-9d269b7a-731e-4367-b9f3-a207b3f8fb7a service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG nova.compute.manager [req-4fb0c151-7c53-4015-9320-6592edbe5b98 req-9d269b7a-731e-4367-b9f3-a207b3f8fb7a service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] No waiting events found dispatching network-vif-unplugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:23 user nova-compute[71325]: DEBUG nova.compute.manager [req-4fb0c151-7c53-4015-9320-6592edbe5b98 req-9d269b7a-731e-4367-b9f3-a207b3f8fb7a service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-vif-unplugged-0150fcfb-793e-4d51-966c-c30195a9802f for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:57:23 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 03554793-01dd-4629-97c7-b640f5934639] Instance destroyed successfully.
Apr 13 21:57:23 user nova-compute[71325]: DEBUG nova.objects.instance [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'resources' on Instance uuid 03554793-01dd-4629-97c7-b640f5934639 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Starting finish_migration {{(pid=71325) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance directory exists: not creating {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 21:57:24 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Creating image(s)
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.objects.instance [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'trusted_certs' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:52:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-808147313',display_name='tempest-TestMinimumBasicScenario-server-808147313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-808147313',id=20,image_ref='8d241d02-be9d-4e4d-b10c-ab4729e58ff8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFchKKqHuC1A8TVFkKSWtfAOCeALfKG5uYpEQTwmP5PX7R4ATfyOZxxZVyd+GOJywfIC+zr0Ar04FqfPo8XD9N72V5J7q/z2PYiROQQ6v4nThfjKvGI9C5bEr2NM1HThiA==',key_name='tempest-TestMinimumBasicScenario-636650613',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:52:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d4e8c27ff7d4fa9a61e000c9d02c5f4',ramdisk_id='',reservation_id='r-x0tgbjv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d241d02-be9d-4e4d-b10c-ab4729e58ff8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1800545339',owner_user_name='tempest-TestMinimumBasicScenario-1800545339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:54:46Z,user_data=None,user_id='710e0446cf794e94b3ab29bb0d7e10d8',uuid=03554793-01dd-4629-97c7-b640f5934639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converting VIF {"id": "0150fcfb-793e-4d51-966c-c30195a9802f", "address": "fa:16:3e:63:fe:50", "network": {"id": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1404677013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4e8c27ff7d4fa9a61e000c9d02c5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0150fcfb-79", "ovs_interfaceid": "0150fcfb-793e-4d51-966c-c30195a9802f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:fe:50,bridge_name='br-int',has_traffic_filtering=True,id=0150fcfb-793e-4d51-966c-c30195a9802f,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0150fcfb-79') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_vif [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:fe:50,bridge_name='br-int',has_traffic_filtering=True,id=0150fcfb-793e-4d51-966c-c30195a9802f,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0150fcfb-79') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0150fcfb-79, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:57:24 user nova-compute[71325]: INFO os_vif [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:fe:50,bridge_name='br-int',has_traffic_filtering=True,id=0150fcfb-793e-4d51-966c-c30195a9802f,network=Network(7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0150fcfb-79')
Apr 13 21:57:24 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Deleting instance files /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639_del
Apr 13 21:57:24 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Deletion of /opt/stack/data/nova/instances/03554793-01dd-4629-97c7-b640f5934639_del complete
Apr 13 21:57:24 user nova-compute[71325]: INFO nova.compute.manager [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 03554793-01dd-4629-97c7-b640f5934639] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 03554793-01dd-4629-97c7-b640f5934639] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.158s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Cannot resize image /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Ensure instance console log exists: /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Start _get_guest_xml network_info=[{"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1784901700-network", "vif_mac": "fa:16:3e:ef:31:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBajDAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c895d9cf-e6c1-42d6-88e3-1209b203fbe3', 'attached_at': '2023-04-13T21:57:24.000000', 'detached_at': '', 'volume_id': '026beb94-6220-4541-8c6b-3296ae986d4a', 'serial': '026beb94-6220-4541-8c6b-3296ae986d4a'}, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '21542999-6ca9-4ee0-b08f-e792731ea36f', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:57:24 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:57:24 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.objects.instance [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'vcpu_model' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBajDAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:57:24 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:57:24 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:57:24 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e2ed9e-411f-4b55-8550-b8e59b6c2711]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:57:24 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7238b5df-6ab4-42bb-9340-7dfd8dad73fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a] added
Apr 13 21:57:24 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b402ef8-0354-4529-a6a0-537357372a69]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6747ccd-3489-479e-b75d-3f111f2ec5f4]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBajDAYp {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBajDAYp" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[646d5866-d376-4bad-98f6-5d0be87f1c4d]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XBajDAYp'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84bbd11-7781-4336-9981-e46daa966cb2]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9eb2d72-acfb-4d9c-b589-536f2b70cbf0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:24 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:24 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:24 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:24 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:24 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:24 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 03554793-01dd-4629-97c7-b640f5934639] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:57:24 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 03554793-01dd-4629-97c7-b640f5934639] Took 0.50 seconds to deallocate network for instance.
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e796272f-606a-4e21-9b9f-cbb4acc035eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260]
Apr 13 21:57:24 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260] successful.
Apr 13 21:57:24 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4500546-d2b1-4d7c-ad79-059f0fa3562c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccf94eb-0161-4d5a-92be-2b63cb236538]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:24 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:24 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:24 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:24 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:24 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:24 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:24 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:24 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d84573-003a-4e83-9b63-2f05c11b3a40]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:57:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBajDAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:25 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Deleted allocations for instance 03554793-01dd-4629-97c7-b640f5934639
Apr 13 21:57:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "03554793-01dd-4629-97c7-b640f5934639" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.046s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.compute.manager [req-8abd2822-231d-432e-a754-2c22fc0393d3 req-0ea3b5e8-7367-4464-ab3e-16c19c981dc2 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8abd2822-231d-432e-a754-2c22fc0393d3 req-0ea3b5e8-7367-4464-ab3e-16c19c981dc2 service nova] Acquiring lock "03554793-01dd-4629-97c7-b640f5934639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8abd2822-231d-432e-a754-2c22fc0393d3 req-0ea3b5e8-7367-4464-ab3e-16c19c981dc2 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8abd2822-231d-432e-a754-2c22fc0393d3 req-0ea3b5e8-7367-4464-ab3e-16c19c981dc2 service nova] Lock "03554793-01dd-4629-97c7-b640f5934639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.compute.manager [req-8abd2822-231d-432e-a754-2c22fc0393d3 req-0ea3b5e8-7367-4464-ab3e-16c19c981dc2 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] No waiting events found dispatching network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:25 user nova-compute[71325]: WARNING nova.compute.manager [req-8abd2822-231d-432e-a754-2c22fc0393d3 req-0ea3b5e8-7367-4464-ab3e-16c19c981dc2 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received unexpected event network-vif-plugged-0150fcfb-793e-4d51-966c-c30195a9802f for instance with vm_state deleted and task_state None.
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.compute.manager [req-8abd2822-231d-432e-a754-2c22fc0393d3 req-0ea3b5e8-7367-4464-ab3e-16c19c981dc2 service nova] [instance: 03554793-01dd-4629-97c7-b640f5934639] Received event network-vif-deleted-0150fcfb-793e-4d51-966c-c30195a9802f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23432336236313934', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432336236313934', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-968149372',display_name='tempest-ServerActionsTestJSON-server-1348347503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-968149372',id=14,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-p35kb61w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:57:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=c895d9cf-e6c1-42d6-88e3-1209b203fbe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1784901700-network", "vif_mac": "fa:16:3e:ef:31:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1784901700-network", "vif_mac": "fa:16:3e:ef:31:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:57:25 user nova-compute[71325]:   <uuid>c895d9cf-e6c1-42d6-88e3-1209b203fbe3</uuid>
Apr 13 21:57:25 user nova-compute[71325]:   <name>instance-0000000e</name>
Apr 13 21:57:25 user nova-compute[71325]:   <memory>196608</memory>
Apr 13 21:57:25 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:57:25 user nova-compute[71325]:   <metadata>
Apr 13 21:57:25 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:57:25 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:57:25 user nova-compute[71325]:       <nova:name>tempest-ServerActionsTestJSON-server-1348347503</nova:name>
Apr 13 21:57:25 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:57:24</nova:creationTime>
Apr 13 21:57:25 user nova-compute[71325]:       <nova:flavor name="m1.micro">
Apr 13 21:57:25 user nova-compute[71325]:         <nova:memory>192</nova:memory>
Apr 13 21:57:25 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:57:25 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:57:25 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:57:25 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:57:25 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:57:25 user nova-compute[71325]:       <nova:owner>
Apr 13 21:57:25 user nova-compute[71325]:         <nova:user uuid="b3db8b01a05b43f68bfd8695253514db">tempest-ServerActionsTestJSON-236976022-project-member</nova:user>
Apr 13 21:57:25 user nova-compute[71325]:         <nova:project uuid="7c086cffbafb4da68f172ab27da232d3">tempest-ServerActionsTestJSON-236976022</nova:project>
Apr 13 21:57:25 user nova-compute[71325]:       </nova:owner>
Apr 13 21:57:25 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:57:25 user nova-compute[71325]:       <nova:ports>
Apr 13 21:57:25 user nova-compute[71325]:         <nova:port uuid="03480082-c22f-4ad9-bc15-d536f115ec88">
Apr 13 21:57:25 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 21:57:25 user nova-compute[71325]:         </nova:port>
Apr 13 21:57:25 user nova-compute[71325]:       </nova:ports>
Apr 13 21:57:25 user nova-compute[71325]:     </nova:instance>
Apr 13 21:57:25 user nova-compute[71325]:   </metadata>
Apr 13 21:57:25 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:57:25 user nova-compute[71325]:     <system>
Apr 13 21:57:25 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:57:25 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:57:25 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:57:25 user nova-compute[71325]:       <entry name="serial">c895d9cf-e6c1-42d6-88e3-1209b203fbe3</entry>
Apr 13 21:57:25 user nova-compute[71325]:       <entry name="uuid">c895d9cf-e6c1-42d6-88e3-1209b203fbe3</entry>
Apr 13 21:57:25 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:57:25 user nova-compute[71325]:     </system>
Apr 13 21:57:25 user nova-compute[71325]:   </sysinfo>
Apr 13 21:57:25 user nova-compute[71325]:   <os>
Apr 13 21:57:25 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:57:25 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:57:25 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:57:25 user nova-compute[71325]:   </os>
Apr 13 21:57:25 user nova-compute[71325]:   <features>
Apr 13 21:57:25 user nova-compute[71325]:     <acpi/>
Apr 13 21:57:25 user nova-compute[71325]:     <apic/>
Apr 13 21:57:25 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:57:25 user nova-compute[71325]:   </features>
Apr 13 21:57:25 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:57:25 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:57:25 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:57:25 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:57:25 user nova-compute[71325]:   </clock>
Apr 13 21:57:25 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:57:25 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:57:25 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:57:25 user nova-compute[71325]:   </cpu>
Apr 13 21:57:25 user nova-compute[71325]:   <devices>
Apr 13 21:57:25 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:57:25 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:57:25 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk"/>
Apr 13 21:57:25 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:57:25 user nova-compute[71325]:     </disk>
Apr 13 21:57:25 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:57:25 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:57:25 user nova-compute[71325]:       <source dev="/dev/sdb"/>
Apr 13 21:57:25 user nova-compute[71325]:       <target dev="vdb" bus="virtio"/>
Apr 13 21:57:25 user nova-compute[71325]:       <serial>026beb94-6220-4541-8c6b-3296ae986d4a</serial>
Apr 13 21:57:25 user nova-compute[71325]:     </disk>
Apr 13 21:57:25 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:57:25 user nova-compute[71325]:       <mac address="fa:16:3e:ef:31:9d"/>
Apr 13 21:57:25 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:57:25 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:57:25 user nova-compute[71325]:       <target dev="tap03480082-c2"/>
Apr 13 21:57:25 user nova-compute[71325]:     </interface>
Apr 13 21:57:25 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:57:25 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/console.log" append="off"/>
Apr 13 21:57:25 user nova-compute[71325]:     </serial>
Apr 13 21:57:25 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:57:25 user nova-compute[71325]:     <video>
Apr 13 21:57:25 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:57:25 user nova-compute[71325]:     </video>
Apr 13 21:57:25 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:57:25 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:57:25 user nova-compute[71325]:     </rng>
Apr 13 21:57:25 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:57:25 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:57:25 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:57:25 user nova-compute[71325]:     </memballoon>
Apr 13 21:57:25 user nova-compute[71325]:   </devices>
Apr 13 21:57:25 user nova-compute[71325]: </domain>
Apr 13 21:57:25 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-968149372',display_name='tempest-ServerActionsTestJSON-server-1348347503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-968149372',id=14,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-p35kb61w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:57:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=c895d9cf-e6c1-42d6-88e3-1209b203fbe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1784901700-network", "vif_mac": "fa:16:3e:ef:31:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1784901700-network", "vif_mac": "fa:16:3e:ef:31:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG os_vif [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03480082-c2, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03480082-c2, col_values=(('external_ids', {'iface-id': '03480082-c22f-4ad9-bc15-d536f115ec88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:31:9d', 'vm-uuid': 'c895d9cf-e6c1-42d6-88e3-1209b203fbe3'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:25 user nova-compute[71325]: INFO os_vif [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2')
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:57:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No VIF found with MAC fa:16:3e:ef:31:9d, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:57:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-2955432c-12a2-4ccc-baba-26c1853f56ff req-a165541f-1703-47f9-b68f-201cbb4fc606 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2955432c-12a2-4ccc-baba-26c1853f56ff req-a165541f-1703-47f9-b68f-201cbb4fc606 service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2955432c-12a2-4ccc-baba-26c1853f56ff req-a165541f-1703-47f9-b68f-201cbb4fc606 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2955432c-12a2-4ccc-baba-26c1853f56ff req-a165541f-1703-47f9-b68f-201cbb4fc606 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-2955432c-12a2-4ccc-baba-26c1853f56ff req-a165541f-1703-47f9-b68f-201cbb4fc606 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:27 user nova-compute[71325]: WARNING nova.compute.manager [req-2955432c-12a2-4ccc-baba-26c1853f56ff req-a165541f-1703-47f9-b68f-201cbb4fc606 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state active and task_state resize_finish.
Apr 13 21:57:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:28 user nova-compute[71325]: DEBUG nova.compute.manager [req-7f49bc52-9c00-4bd4-8a4d-cfc5c882a933 req-cdbe4220-ea1f-4e09-8498-ac48833bbf9a service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Received event network-changed-281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:28 user nova-compute[71325]: DEBUG nova.compute.manager [req-7f49bc52-9c00-4bd4-8a4d-cfc5c882a933 req-cdbe4220-ea1f-4e09-8498-ac48833bbf9a service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Refreshing instance network info cache due to event network-changed-281f102d-de13-4548-a18c-3e452509c97c. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:57:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7f49bc52-9c00-4bd4-8a4d-cfc5c882a933 req-cdbe4220-ea1f-4e09-8498-ac48833bbf9a service nova] Acquiring lock "refresh_cache-68dbaff0-73ca-4caa-bd4f-f97065df4409" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:57:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7f49bc52-9c00-4bd4-8a4d-cfc5c882a933 req-cdbe4220-ea1f-4e09-8498-ac48833bbf9a service nova] Acquired lock "refresh_cache-68dbaff0-73ca-4caa-bd4f-f97065df4409" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:57:28 user nova-compute[71325]: DEBUG nova.network.neutron [req-7f49bc52-9c00-4bd4-8a4d-cfc5c882a933 req-cdbe4220-ea1f-4e09-8498-ac48833bbf9a service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Refreshing network info cache for port 281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:57:28 user nova-compute[71325]: DEBUG nova.network.neutron [req-7f49bc52-9c00-4bd4-8a4d-cfc5c882a933 req-cdbe4220-ea1f-4e09-8498-ac48833bbf9a service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Updated VIF entry in instance network info cache for port 281f102d-de13-4548-a18c-3e452509c97c. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:57:28 user nova-compute[71325]: DEBUG nova.network.neutron [req-7f49bc52-9c00-4bd4-8a4d-cfc5c882a933 req-cdbe4220-ea1f-4e09-8498-ac48833bbf9a service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Updating instance_info_cache with network_info: [{"id": "281f102d-de13-4548-a18c-3e452509c97c", "address": "fa:16:3e:8d:19:2f", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281f102d-de", "ovs_interfaceid": "281f102d-de13-4548-a18c-3e452509c97c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:57:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-7f49bc52-9c00-4bd4-8a4d-cfc5c882a933 req-cdbe4220-ea1f-4e09-8498-ac48833bbf9a service nova] Releasing lock "refresh_cache-68dbaff0-73ca-4caa-bd4f-f97065df4409" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:57:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:28 user nova-compute[71325]: DEBUG nova.objects.instance [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'flavor' on Instance uuid 68dbaff0-73ca-4caa-bd4f-f97065df4409 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:28 user nova-compute[71325]: INFO nova.compute.manager [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Attaching volume 974804e5-626d-4a7a-b7a7-1ef0655b28fc to /dev/vdb
Apr 13 21:57:29 user nova-compute[71325]: DEBUG os_brick.utils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef025b05-f585-4f47-875c-ae9bae5a717b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f1cc6f-da28-473f-93b4-9e55b5660d06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ffa9ac-cd75-4d64-81a9-6459754868ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacec0cb-5dc5-44df-a71c-72a4141a3901]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:57:29 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[73388087-a6f5-4d4f-a30b-d1ede880d667]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG os_brick.utils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Updating existing volume attachment record: 4f99b1e7-234f-4ebc-bf11-53dc84a7acd4 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for c895d9cf-e6c1-42d6-88e3-1209b203fbe3 due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423049.412665, c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:57:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] VM Resumed (Lifecycle Event)
Apr 13 21:57:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:57:29 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance running successfully.
Apr 13 21:57:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Failed to set time: agent not configured {{(pid=71325) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] finish_migration finished successfully. {{(pid=71325) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:57:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 21:57:29 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423049.414923, c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:57:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] VM Started (Lifecycle Event)
Apr 13 21:57:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG nova.compute.manager [req-49ae0b75-ea27-43a3-950c-3378c75ab8d0 req-e8e3f08d-de55-4ce8-8566-e568616fab6a service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49ae0b75-ea27-43a3-950c-3378c75ab8d0 req-e8e3f08d-de55-4ce8-8566-e568616fab6a service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49ae0b75-ea27-43a3-950c-3378c75ab8d0 req-e8e3f08d-de55-4ce8-8566-e568616fab6a service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49ae0b75-ea27-43a3-950c-3378c75ab8d0 req-e8e3f08d-de55-4ce8-8566-e568616fab6a service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:29 user nova-compute[71325]: DEBUG nova.compute.manager [req-49ae0b75-ea27-43a3-950c-3378c75ab8d0 req-e8e3f08d-de55-4ce8-8566-e568616fab6a service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:29 user nova-compute[71325]: WARNING nova.compute.manager [req-49ae0b75-ea27-43a3-950c-3378c75ab8d0 req-e8e3f08d-de55-4ce8-8566-e568616fab6a service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state active and task_state resize_finish.
Apr 13 21:57:29 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 21:57:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:33 user nova-compute[71325]: INFO nova.compute.manager [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Unrescuing
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquired lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG nova.network.neutron [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEtgbHSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:57:33 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:57:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:57:33 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:57:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:57:33 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabffd24-1fbc-4459-bad6-3f05f4e8df55]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:57:33 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2439e4-7311-440d-a98f-8d5ea49d2659]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc] added
Apr 13 21:57:33 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd07c52e-8af2-4b7e-9ed1-6f0992784f8e]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5867f4de-c3f5-433d-8b14-fcf71e06e444]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BEtgbHSy {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BEtgbHSy" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccd27b8-e393-498f-9ab2-6937a7506d6f]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BEtgbHSy'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38defe4-73f1-4885-952d-55f79205405e]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[533837d9-58e3-4265-9739-6acfb0036d15]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:34 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:34 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:34 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:34 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:34 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:34 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:34 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:34 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG nova.network.neutron [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Updating instance_info_cache with network_info: [{"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Releasing lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG nova.objects.instance [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'flavor' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd771d28-b49d-475b-9213-7328573a7b6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc, portal: 172.16.0.220,3260]
Apr 13 21:57:34 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc, portal: 172.16.0.220,3260] successful.
Apr 13 21:57:34 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeec200-18af-45e2-8721-c86ca785aa4a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad10db9e-5842-47ea-ada3-7702d7a37c1e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:34 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:34 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:34 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:34 user nova-compute[71325]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc (non-flash)
Apr 13 21:57:34 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:34 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:34 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:34 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:34 user nova-compute[71325]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc (non-flash)
Apr 13 21:57:34 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[726f75b6-5d4e-4dc7-b3ea-2c2d24117dc1]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEtgbHSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-ae291c38-d006-4b1c-bbe9-4786e89257fa req-2bced852-7242-46f3-af00-ddf5358636ec service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-vif-unplugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ae291c38-d006-4b1c-bbe9-4786e89257fa req-2bced852-7242-46f3-af00-ddf5358636ec service nova] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ae291c38-d006-4b1c-bbe9-4786e89257fa req-2bced852-7242-46f3-af00-ddf5358636ec service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ae291c38-d006-4b1c-bbe9-4786e89257fa req-2bced852-7242-46f3-af00-ddf5358636ec service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG nova.compute.manager [req-ae291c38-d006-4b1c-bbe9-4786e89257fa req-2bced852-7242-46f3-af00-ddf5358636ec service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] No waiting events found dispatching network-vif-unplugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:34 user nova-compute[71325]: WARNING nova.compute.manager [req-ae291c38-d006-4b1c-bbe9-4786e89257fa req-2bced852-7242-46f3-af00-ddf5358636ec service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received unexpected event network-vif-unplugged-a438af72-b7ff-4ab6-82f5-59cf460c430f for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:57:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:34 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Instance destroyed successfully.
Apr 13 21:57:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "9c729f61-da40-49d7-8f93-d9bbe30fa877" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "9c729f61-da40-49d7-8f93-d9bbe30fa877" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:35 user nova-compute[71325]: INFO nova.compute.manager [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Terminating instance
Apr 13 21:57:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26530653938363966', 'path': '/dev/sdc'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530653938363966', 'path': '/dev/sdc'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG nova.objects.instance [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'flavor' on Instance uuid 68dbaff0-73ca-4caa-bd4f-f97065df4409 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:57:35 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:57:35 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:57:35 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:57:35 user nova-compute[71325]:   <serial>974804e5-626d-4a7a-b7a7-1ef0655b28fc</serial>
Apr 13 21:57:35 user nova-compute[71325]: </disk>
Apr 13 21:57:35 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG nova.compute.manager [req-9dd97fb3-c125-4d11-9938-97b437b4d7c8 req-30e9aa87-1335-4543-8cab-33c2d33c92b3 service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Received event network-vif-unplugged-330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9dd97fb3-c125-4d11-9938-97b437b4d7c8 req-30e9aa87-1335-4543-8cab-33c2d33c92b3 service nova] Acquiring lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9dd97fb3-c125-4d11-9938-97b437b4d7c8 req-30e9aa87-1335-4543-8cab-33c2d33c92b3 service nova] Lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9dd97fb3-c125-4d11-9938-97b437b4d7c8 req-30e9aa87-1335-4543-8cab-33c2d33c92b3 service nova] Lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG nova.compute.manager [req-9dd97fb3-c125-4d11-9938-97b437b4d7c8 req-30e9aa87-1335-4543-8cab-33c2d33c92b3 service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] No waiting events found dispatching network-vif-unplugged-330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG nova.compute.manager [req-9dd97fb3-c125-4d11-9938-97b437b4d7c8 req-30e9aa87-1335-4543-8cab-33c2d33c92b3 service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Received event network-vif-unplugged-330b43f2-b324-4cbf-953e-7225711aa856 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:36 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Instance destroyed successfully.
Apr 13 21:57:36 user nova-compute[71325]: DEBUG nova.objects.instance [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'resources' on Instance uuid 9c729f61-da40-49d7-8f93-d9bbe30fa877 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-478774448',display_name='tempest-AttachVolumeNegativeTest-server-478774448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-478774448',id=27,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZc162tVythJhaJKRScqNIf+KMZxBjwe1ZrmXTBaQ3UKcFvBbLYWcAWzW2akMkMDvhbMf7BPoc9Gk1B4keTA03dVAmolivOo4U4/bjoKaWU2eORcyTrFfFocUk/JK/A2Q==',key_name='tempest-keypair-938295147',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:55:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='446b51db737947ab9bddd5fc47488bc7',ramdisk_id='',reservation_id='r-3r70nw0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-920375840',owner_user_name='tempest-AttachVolumeNegativeTest-920375840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:55:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145c0a177fcc4b94b5480d8806554ac9',uuid=9c729f61-da40-49d7-8f93-d9bbe30fa877,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "330b43f2-b324-4cbf-953e-7225711aa856", "address": "fa:16:3e:fd:11:8e", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330b43f2-b3", "ovs_interfaceid": "330b43f2-b324-4cbf-953e-7225711aa856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converting VIF {"id": "330b43f2-b324-4cbf-953e-7225711aa856", "address": "fa:16:3e:fd:11:8e", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330b43f2-b3", "ovs_interfaceid": "330b43f2-b324-4cbf-953e-7225711aa856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:11:8e,bridge_name='br-int',has_traffic_filtering=True,id=330b43f2-b324-4cbf-953e-7225711aa856,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330b43f2-b3') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG os_vif [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:11:8e,bridge_name='br-int',has_traffic_filtering=True,id=330b43f2-b324-4cbf-953e-7225711aa856,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330b43f2-b3') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap330b43f2-b3, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:36 user nova-compute[71325]: INFO os_vif [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:11:8e,bridge_name='br-int',has_traffic_filtering=True,id=330b43f2-b324-4cbf-953e-7225711aa856,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330b43f2-b3')
Apr 13 21:57:36 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Deleting instance files /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877_del
Apr 13 21:57:36 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Deletion of /opt/stack/data/nova/instances/9c729f61-da40-49d7-8f93-d9bbe30fa877_del complete
Apr 13 21:57:36 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] No VIF found with MAC fa:16:3e:8d:19:2f, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:57:36 user nova-compute[71325]: INFO nova.compute.manager [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 13 21:57:36 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.491s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Received event network-changed-330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Refreshing instance network info cache due to event network-changed-330b43f2-b324-4cbf-953e-7225711aa856. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] Acquiring lock "refresh_cache-9c729f61-da40-49d7-8f93-d9bbe30fa877" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] Acquired lock "refresh_cache-9c729f61-da40-49d7-8f93-d9bbe30fa877" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Refreshing network info cache for port 330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:37 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Took 0.78 seconds to deallocate network for instance.
Apr 13 21:57:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-8632dc65-e4c6-477a-95e0-8d457b75ea05 req-8a82ef8c-076a-4e1a-9817-62251fedfbd5 service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Received event network-vif-plugged-330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8632dc65-e4c6-477a-95e0-8d457b75ea05 req-8a82ef8c-076a-4e1a-9817-62251fedfbd5 service nova] Acquiring lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8632dc65-e4c6-477a-95e0-8d457b75ea05 req-8a82ef8c-076a-4e1a-9817-62251fedfbd5 service nova] Lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8632dc65-e4c6-477a-95e0-8d457b75ea05 req-8a82ef8c-076a-4e1a-9817-62251fedfbd5 service nova] Lock "9c729f61-da40-49d7-8f93-d9bbe30fa877-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-8632dc65-e4c6-477a-95e0-8d457b75ea05 req-8a82ef8c-076a-4e1a-9817-62251fedfbd5 service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] No waiting events found dispatching network-vif-plugged-330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:37 user nova-compute[71325]: WARNING nova.compute.manager [req-8632dc65-e4c6-477a-95e0-8d457b75ea05 req-8a82ef8c-076a-4e1a-9817-62251fedfbd5 service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Received unexpected event network-vif-plugged-330b43f2-b324-4cbf-953e-7225711aa856 for instance with vm_state deleted and task_state None.
Apr 13 21:57:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-8632dc65-e4c6-477a-95e0-8d457b75ea05 req-8a82ef8c-076a-4e1a-9817-62251fedfbd5 service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Received event network-vif-deleted-330b43f2-b324-4cbf-953e-7225711aa856 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Updated VIF entry in instance network info cache for port 330b43f2-b324-4cbf-953e-7225711aa856. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Updating instance_info_cache with network_info: [{"id": "330b43f2-b324-4cbf-953e-7225711aa856", "address": "fa:16:3e:fd:11:8e", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330b43f2-b3", "ovs_interfaceid": "330b43f2-b324-4cbf-953e-7225711aa856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] Releasing lock "refresh_cache-9c729f61-da40-49d7-8f93-d9bbe30fa877" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] No waiting events found dispatching network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:37 user nova-compute[71325]: WARNING nova.compute.manager [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received unexpected event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:57:37 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:37 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Deleted allocations for instance 9c729f61-da40-49d7-8f93-d9bbe30fa877
Apr 13 21:57:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "9c729f61-da40-49d7-8f93-d9bbe30fa877" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.720s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "bfcfa307-25f3-43e0-837b-704b5cd7783f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:57:38 user nova-compute[71325]: INFO nova.compute.claims [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Claim successful on node user
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:57:38 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] No waiting events found dispatching network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:38 user nova-compute[71325]: WARNING nova.compute.manager [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received unexpected event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] No waiting events found dispatching network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:38 user nova-compute[71325]: WARNING nova.compute.manager [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received unexpected event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.policy [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:57:38 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Creating image(s)
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "/opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "/opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:38 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423043.9881399, 03554793-01dd-4629-97c7-b640f5934639 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:57:38 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 03554793-01dd-4629-97c7-b640f5934639] VM Stopped (Lifecycle Event)
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-78233f06-f066-4ba0-809d-df953e49573c None None] [instance: 03554793-01dd-4629-97c7-b640f5934639] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.130s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk 1073741824" returned: 0 in 0.058s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for b87dfe1b-f651-436d-87b5-eb257ef1a6e8 due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423059.2183425, b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:57:39 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] VM Resumed (Lifecycle Event)
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.network.neutron [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Successfully created port: 67f4855a-44cd-42ff-87f6-9f0704b9960a {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.objects.instance [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'flavor' on Instance uuid 68dbaff0-73ca-4caa-bd4f-f97065df4409 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423059.2220833, b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:57:39 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] VM Started (Lifecycle Event)
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Cannot resize image /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.objects.instance [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'migration_context' on Instance uuid bfcfa307-25f3-43e0-837b-704b5cd7783f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Ensure instance console log exists: /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:39 user nova-compute[71325]: INFO nova.compute.manager [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Attaching volume 4732c9ce-0873-4c34-82bd-aee4d8b249f8 to /dev/vdc
Apr 13 21:57:39 user nova-compute[71325]: DEBUG os_brick.utils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[00604c3f-caa1-4eb6-a813-67a9b1e1d5eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36ff44d-fe6a-4a93-9900-aaa7f8dddae5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b86ebd5-d2c8-4ab4-9fc6-a3485bd772cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea261b91-85b7-4fd5-afbe-86d45df0c581]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:57:39 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:57:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc1a935-cc0f-46d8-a3ab-aa527d89d3d0]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG os_brick.utils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:57:39 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Updating existing volume attachment record: 9e78ab86-3af4-4471-899b-03f28b8e0586 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.network.neutron [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Successfully updated port: 67f4855a-44cd-42ff-87f6-9f0704b9960a {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "refresh_cache-bfcfa307-25f3-43e0-837b-704b5cd7783f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquired lock "refresh_cache-bfcfa307-25f3-43e0-837b-704b5cd7783f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.network.neutron [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.network.neutron [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.network.neutron [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Updating instance_info_cache with network_info: [{"id": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "address": "fa:16:3e:0c:02:5e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4855a-44", "ovs_interfaceid": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Releasing lock "refresh_cache-bfcfa307-25f3-43e0-837b-704b5cd7783f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.compute.manager [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Instance network_info: |[{"id": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "address": "fa:16:3e:0c:02:5e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4855a-44", "ovs_interfaceid": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Start _get_guest_xml network_info=[{"id": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "address": "fa:16:3e:0c:02:5e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4855a-44", "ovs_interfaceid": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:57:40 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:57:40 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-297643457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-297643457',id=29,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11a30fba887e4114be856d26b47a8e55',ramdisk_id='',reservation_id='r-cnf6tw5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-33854562',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:57:39Z,user_data=None,user_id='0ab740920cac4befac62a72f7ce5a817',uuid=bfcfa307-25f3-43e0-837b-704b5cd7783f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "address": "fa:16:3e:0c:02:5e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4855a-44", "ovs_interfaceid": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converting VIF {"id": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "address": "fa:16:3e:0c:02:5e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4855a-44", "ovs_interfaceid": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:02:5e,bridge_name='br-int',has_traffic_filtering=True,id=67f4855a-44cd-42ff-87f6-9f0704b9960a,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f4855a-44') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.objects.instance [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'pci_devices' on Instance uuid bfcfa307-25f3-43e0-837b-704b5cd7783f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:57:40 user nova-compute[71325]:   <uuid>bfcfa307-25f3-43e0-837b-704b5cd7783f</uuid>
Apr 13 21:57:40 user nova-compute[71325]:   <name>instance-0000001d</name>
Apr 13 21:57:40 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:57:40 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:57:40 user nova-compute[71325]:   <metadata>
Apr 13 21:57:40 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:57:40 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:57:40 user nova-compute[71325]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-297643457</nova:name>
Apr 13 21:57:40 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:57:40</nova:creationTime>
Apr 13 21:57:40 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:57:40 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:57:40 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:57:40 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:57:40 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:57:40 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:57:40 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:57:40 user nova-compute[71325]:       <nova:owner>
Apr 13 21:57:40 user nova-compute[71325]:         <nova:user uuid="0ab740920cac4befac62a72f7ce5a817">tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member</nova:user>
Apr 13 21:57:40 user nova-compute[71325]:         <nova:project uuid="11a30fba887e4114be856d26b47a8e55">tempest-ServerBootFromVolumeStableRescueTest-33854562</nova:project>
Apr 13 21:57:40 user nova-compute[71325]:       </nova:owner>
Apr 13 21:57:40 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:57:40 user nova-compute[71325]:       <nova:ports>
Apr 13 21:57:40 user nova-compute[71325]:         <nova:port uuid="67f4855a-44cd-42ff-87f6-9f0704b9960a">
Apr 13 21:57:40 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 21:57:40 user nova-compute[71325]:         </nova:port>
Apr 13 21:57:40 user nova-compute[71325]:       </nova:ports>
Apr 13 21:57:40 user nova-compute[71325]:     </nova:instance>
Apr 13 21:57:40 user nova-compute[71325]:   </metadata>
Apr 13 21:57:40 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:57:40 user nova-compute[71325]:     <system>
Apr 13 21:57:40 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:57:40 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:57:40 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:57:40 user nova-compute[71325]:       <entry name="serial">bfcfa307-25f3-43e0-837b-704b5cd7783f</entry>
Apr 13 21:57:40 user nova-compute[71325]:       <entry name="uuid">bfcfa307-25f3-43e0-837b-704b5cd7783f</entry>
Apr 13 21:57:40 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:57:40 user nova-compute[71325]:     </system>
Apr 13 21:57:40 user nova-compute[71325]:   </sysinfo>
Apr 13 21:57:40 user nova-compute[71325]:   <os>
Apr 13 21:57:40 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:57:40 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:57:40 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:57:40 user nova-compute[71325]:   </os>
Apr 13 21:57:40 user nova-compute[71325]:   <features>
Apr 13 21:57:40 user nova-compute[71325]:     <acpi/>
Apr 13 21:57:40 user nova-compute[71325]:     <apic/>
Apr 13 21:57:40 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:57:40 user nova-compute[71325]:   </features>
Apr 13 21:57:40 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:57:40 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:57:40 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:57:40 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:57:40 user nova-compute[71325]:   </clock>
Apr 13 21:57:40 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:57:40 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:57:40 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:57:40 user nova-compute[71325]:   </cpu>
Apr 13 21:57:40 user nova-compute[71325]:   <devices>
Apr 13 21:57:40 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:57:40 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:57:40 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk"/>
Apr 13 21:57:40 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:57:40 user nova-compute[71325]:     </disk>
Apr 13 21:57:40 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:57:40 user nova-compute[71325]:       <mac address="fa:16:3e:0c:02:5e"/>
Apr 13 21:57:40 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:57:40 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:57:40 user nova-compute[71325]:       <target dev="tap67f4855a-44"/>
Apr 13 21:57:40 user nova-compute[71325]:     </interface>
Apr 13 21:57:40 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:57:40 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/console.log" append="off"/>
Apr 13 21:57:40 user nova-compute[71325]:     </serial>
Apr 13 21:57:40 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:57:40 user nova-compute[71325]:     <video>
Apr 13 21:57:40 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:57:40 user nova-compute[71325]:     </video>
Apr 13 21:57:40 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:57:40 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:57:40 user nova-compute[71325]:     </rng>
Apr 13 21:57:40 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:57:40 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:57:40 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:57:40 user nova-compute[71325]:     </memballoon>
Apr 13 21:57:40 user nova-compute[71325]:   </devices>
Apr 13 21:57:40 user nova-compute[71325]: </domain>
Apr 13 21:57:40 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-297643457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-297643457',id=29,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11a30fba887e4114be856d26b47a8e55',ramdisk_id='',reservation_id='r-cnf6tw5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-33854562',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:57:39Z,user_data=None,user_id='0ab740920cac4befac62a72f7ce5a817',uuid=bfcfa307-25f3-43e0-837b-704b5cd7783f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "address": "fa:16:3e:0c:02:5e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4855a-44", "ovs_interfaceid": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converting VIF {"id": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "address": "fa:16:3e:0c:02:5e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4855a-44", "ovs_interfaceid": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:02:5e,bridge_name='br-int',has_traffic_filtering=True,id=67f4855a-44cd-42ff-87f6-9f0704b9960a,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f4855a-44') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG os_vif [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:02:5e,bridge_name='br-int',has_traffic_filtering=True,id=67f4855a-44cd-42ff-87f6-9f0704b9960a,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f4855a-44') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67f4855a-44, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67f4855a-44, col_values=(('external_ids', {'iface-id': '67f4855a-44cd-42ff-87f6-9f0704b9960a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:02:5e', 'vm-uuid': 'bfcfa307-25f3-43e0-837b-704b5cd7783f'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:40 user nova-compute[71325]: INFO os_vif [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:02:5e,bridge_name='br-int',has_traffic_filtering=True,id=67f4855a-44cd-42ff-87f6-9f0704b9960a,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f4855a-44')
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] No VIF found with MAC fa:16:3e:0c:02:5e, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-f96fc715-ff29-448a-9cbb-0db8ffb66f5b req-58508cf5-7b4f-44c5-a1a9-ffa1060d2ccc service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Received event network-changed-67f4855a-44cd-42ff-87f6-9f0704b9960a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-f96fc715-ff29-448a-9cbb-0db8ffb66f5b req-58508cf5-7b4f-44c5-a1a9-ffa1060d2ccc service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Refreshing instance network info cache due to event network-changed-67f4855a-44cd-42ff-87f6-9f0704b9960a. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f96fc715-ff29-448a-9cbb-0db8ffb66f5b req-58508cf5-7b4f-44c5-a1a9-ffa1060d2ccc service nova] Acquiring lock "refresh_cache-bfcfa307-25f3-43e0-837b-704b5cd7783f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f96fc715-ff29-448a-9cbb-0db8ffb66f5b req-58508cf5-7b4f-44c5-a1a9-ffa1060d2ccc service nova] Acquired lock "refresh_cache-bfcfa307-25f3-43e0-837b-704b5cd7783f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:57:40 user nova-compute[71325]: DEBUG nova.network.neutron [req-f96fc715-ff29-448a-9cbb-0db8ffb66f5b req-58508cf5-7b4f-44c5-a1a9-ffa1060d2ccc service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Refreshing network info cache for port 67f4855a-44cd-42ff-87f6-9f0704b9960a {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:57:41 user nova-compute[71325]: DEBUG nova.network.neutron [req-f96fc715-ff29-448a-9cbb-0db8ffb66f5b req-58508cf5-7b4f-44c5-a1a9-ffa1060d2ccc service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Updated VIF entry in instance network info cache for port 67f4855a-44cd-42ff-87f6-9f0704b9960a. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:57:41 user nova-compute[71325]: DEBUG nova.network.neutron [req-f96fc715-ff29-448a-9cbb-0db8ffb66f5b req-58508cf5-7b4f-44c5-a1a9-ffa1060d2ccc service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Updating instance_info_cache with network_info: [{"id": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "address": "fa:16:3e:0c:02:5e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4855a-44", "ovs_interfaceid": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:57:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f96fc715-ff29-448a-9cbb-0db8ffb66f5b req-58508cf5-7b4f-44c5-a1a9-ffa1060d2ccc service nova] Releasing lock "refresh_cache-bfcfa307-25f3-43e0-837b-704b5cd7783f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:57:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-089b40ca-49f3-41fb-b72b-05fca878aef9 req-df487899-66e4-4823-b4a7-5c0a5d690ca0 service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Received event network-vif-plugged-67f4855a-44cd-42ff-87f6-9f0704b9960a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-089b40ca-49f3-41fb-b72b-05fca878aef9 req-df487899-66e4-4823-b4a7-5c0a5d690ca0 service nova] Acquiring lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-089b40ca-49f3-41fb-b72b-05fca878aef9 req-df487899-66e4-4823-b4a7-5c0a5d690ca0 service nova] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-089b40ca-49f3-41fb-b72b-05fca878aef9 req-df487899-66e4-4823-b4a7-5c0a5d690ca0 service nova] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-089b40ca-49f3-41fb-b72b-05fca878aef9 req-df487899-66e4-4823-b4a7-5c0a5d690ca0 service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] No waiting events found dispatching network-vif-plugged-67f4855a-44cd-42ff-87f6-9f0704b9960a {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:42 user nova-compute[71325]: WARNING nova.compute.manager [req-089b40ca-49f3-41fb-b72b-05fca878aef9 req-df487899-66e4-4823-b4a7-5c0a5d690ca0 service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Received unexpected event network-vif-plugged-67f4855a-44cd-42ff-87f6-9f0704b9960a for instance with vm_state building and task_state spawning.
Apr 13 21:57:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423064.347456, bfcfa307-25f3-43e0-837b-704b5cd7783f => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:57:44 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] VM Resumed (Lifecycle Event)
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:57:44 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Instance spawned successfully.
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:57:44 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423064.3487492, bfcfa307-25f3-43e0-837b-704b5cd7783f => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:57:44 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] VM Started (Lifecycle Event)
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEMhpZSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:57:44 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:57:44 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:57:44 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[10190756-b372-40f2-b6ff-bf36865b3ca6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:57:44 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:44 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:44 user nova-compute[71325]: INFO nova.compute.manager [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Took 5.70 seconds to spawn the instance on the hypervisor.
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c574e6da-1ef5-4fc4-9736-2cee948a3fb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8] added
Apr 13 21:57:44 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-78d023d8-ba69-4453-9250-4d2d6515c8ff req-2f099dc1-b2c8-4baf-9ec3-1545e8ac55ca service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Received event network-vif-plugged-67f4855a-44cd-42ff-87f6-9f0704b9960a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-78d023d8-ba69-4453-9250-4d2d6515c8ff req-2f099dc1-b2c8-4baf-9ec3-1545e8ac55ca service nova] Acquiring lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-78d023d8-ba69-4453-9250-4d2d6515c8ff req-2f099dc1-b2c8-4baf-9ec3-1545e8ac55ca service nova] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-78d023d8-ba69-4453-9250-4d2d6515c8ff req-2f099dc1-b2c8-4baf-9ec3-1545e8ac55ca service nova] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-78d023d8-ba69-4453-9250-4d2d6515c8ff req-2f099dc1-b2c8-4baf-9ec3-1545e8ac55ca service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] No waiting events found dispatching network-vif-plugged-67f4855a-44cd-42ff-87f6-9f0704b9960a {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:44 user nova-compute[71325]: WARNING nova.compute.manager [req-78d023d8-ba69-4453-9250-4d2d6515c8ff req-2f099dc1-b2c8-4baf-9ec3-1545e8ac55ca service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Received unexpected event network-vif-plugged-67f4855a-44cd-42ff-87f6-9f0704b9960a for instance with vm_state building and task_state spawning.
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2bbcf5-73c7-424a-a885-0098c20f4c4f]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20bc552-3868-4eeb-a7f8-60e71e84e585]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AEMhpZSd {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:44 user nova-compute[71325]: INFO nova.compute.manager [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Took 6.50 seconds to build instance.
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AEMhpZSd" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bcc441-849c-40df-af67-149546dc4b9c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AEMhpZSd'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.606s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a44b1e4-8011-4494-b700-d26d6f830168]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a07476-77be-41a9-a54c-fe77f31f8e61]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc (non-flash)
Apr 13 21:57:44 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc (non-flash)
Apr 13 21:57:44 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcb8ebe-0f7e-4670-b774-4dee41b439ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8, portal: 172.16.0.220,3260]
Apr 13 21:57:44 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8, portal: 172.16.0.220,3260] successful.
Apr 13 21:57:44 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21ce908-6213-4bf4-ba10-93867c4ec7bc]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0193a1b2-e87b-4cab-b833-4030e7757283]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 (non-flash)
Apr 13 21:57:44 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc (non-flash)
Apr 13 21:57:44 user nova-compute[71325]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 (non-flash)
Apr 13 21:57:44 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5eaad3-9b8f-4b26-bccd-4d999f33d591]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:57:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEMhpZSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:57:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:57:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23635303834626566', 'path': '/dev/sdg'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:57:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635303834626566', 'path': '/dev/sdg'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:57:45 user nova-compute[71325]: DEBUG nova.objects.instance [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'flavor' on Instance uuid 68dbaff0-73ca-4caa-bd4f-f97065df4409 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 21:57:45 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:57:45 user nova-compute[71325]:   <source dev="/dev/sdg"/>
Apr 13 21:57:45 user nova-compute[71325]:   <target dev="vdc" bus="virtio"/>
Apr 13 21:57:45 user nova-compute[71325]:   <serial>4732c9ce-0873-4c34-82bd-aee4d8b249f8</serial>
Apr 13 21:57:45 user nova-compute[71325]: </disk>
Apr 13 21:57:45 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 21:57:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:57:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:57:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:57:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] No VIF found with MAC fa:16:3e:8d:19:2f, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:57:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.841s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:47 user nova-compute[71325]: INFO nova.compute.manager [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Detaching volume 974804e5-626d-4a7a-b7a7-1ef0655b28fc
Apr 13 21:57:47 user nova-compute[71325]: INFO nova.virt.block_device [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Attempting to driver detach volume 974804e5-626d-4a7a-b7a7-1ef0655b28fc from mountpoint /dev/vdb
Apr 13 21:57:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Attempting to detach device vdb from instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:57:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:57:47 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:57:47 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:57:47 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:57:47 user nova-compute[71325]:   <serial>974804e5-626d-4a7a-b7a7-1ef0655b28fc</serial>
Apr 13 21:57:47 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:57:47 user nova-compute[71325]: </disk>
Apr 13 21:57:47 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:57:47 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Successfully detached device vdb from instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 from the persistent domain config.
Apr 13 21:57:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:57:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:57:47 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:57:47 user nova-compute[71325]:   <source dev="/dev/sdc"/>
Apr 13 21:57:47 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:57:47 user nova-compute[71325]:   <serial>974804e5-626d-4a7a-b7a7-1ef0655b28fc</serial>
Apr 13 21:57:47 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:57:47 user nova-compute[71325]: </disk>
Apr 13 21:57:47 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681423068.0781653, 68dbaff0-73ca-4caa-bd4f-f97065df4409 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:57:48 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Successfully detached device vdb from instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 from the live domain config.
Apr 13 21:57:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEtgbHSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:57:48 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[172c738a-4c26-41c4-b231-e2b60a9593e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:57:48 user nova-compute[71325]: No targets found.
Apr 13 21:57:48 user nova-compute[71325]: iSNS:
Apr 13 21:57:48 user nova-compute[71325]: No targets found.
Apr 13 21:57:48 user nova-compute[71325]: STATIC:
Apr 13 21:57:48 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8
Apr 13 21:57:48 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:48 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:48 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a
Apr 13 21:57:48 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:48 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:48 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:57:48 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:48 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:48 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808
Apr 13 21:57:48 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:48 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:48 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4
Apr 13 21:57:48 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:48 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:48 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc
Apr 13 21:57:48 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:48 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:48 user nova-compute[71325]: FIRMWARE:
Apr 13 21:57:48 user nova-compute[71325]: No targets found.
Apr 13 21:57:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:57:48 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:57:48 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f21af81-2e42-4599-9ef1-29903a6eac79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb739a2-3f8e-4d4f-8711-cbdc13c397ba]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:48 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:48 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:48 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:48 user nova-compute[71325]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc (non-flash)
Apr 13 21:57:48 user nova-compute[71325]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 (non-flash)
Apr 13 21:57:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:48 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:48 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:48 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:48 user nova-compute[71325]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc (non-flash)
Apr 13 21:57:48 user nova-compute[71325]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 (non-flash)
Apr 13 21:57:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7ebe560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc'): ({'sdc'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Removing single pathed devices sdc {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a8f943-39fb-4667-9f7c-e47ffd15acbe]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88f145e-6de9-4414-9a76-bdf60d0cd1d8]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flushing IO for device /dev/sdc {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7337f8-2ea8-482c-ae6c-4c626dab7ab0]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[78de214e-f16c-41c2-858a-47191e060471]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1777bbce-c42f-4934-bbdf-3fc0d80d14fc]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2621875-2392-4bbc-8bfa-f5f4d393aea8]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc, portal: 172.16.0.220,3260]
Apr 13 21:57:48 user nova-compute[71325]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc, portal: 172.16.0.220,3260] successful.
Apr 13 21:57:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974804e5-626d-4a7a-b7a7-1ef0655b28fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18c9f44-0452-412d-97d8-d248459388b0]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] <== disconnect_volume: return (323ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:57:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:57:49 user nova-compute[71325]: DEBUG nova.objects.instance [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'flavor' on Instance uuid 68dbaff0-73ca-4caa-bd4f-f97065df4409 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.864s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:49 user nova-compute[71325]: INFO nova.compute.manager [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Detaching volume 4732c9ce-0873-4c34-82bd-aee4d8b249f8
Apr 13 21:57:50 user nova-compute[71325]: INFO nova.virt.block_device [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Attempting to driver detach volume 4732c9ce-0873-4c34-82bd-aee4d8b249f8 from mountpoint /dev/vdc
Apr 13 21:57:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Attempting to detach device vdc from instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:57:50 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:57:50 user nova-compute[71325]:   <source dev="/dev/sdg"/>
Apr 13 21:57:50 user nova-compute[71325]:   <target dev="vdc" bus="virtio"/>
Apr 13 21:57:50 user nova-compute[71325]:   <serial>4732c9ce-0873-4c34-82bd-aee4d8b249f8</serial>
Apr 13 21:57:50 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 21:57:50 user nova-compute[71325]: </disk>
Apr 13 21:57:50 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:57:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Successfully detached device vdc from instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 from the persistent domain config.
Apr 13 21:57:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:57:50 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:57:50 user nova-compute[71325]:   <source dev="/dev/sdg"/>
Apr 13 21:57:50 user nova-compute[71325]:   <target dev="vdc" bus="virtio"/>
Apr 13 21:57:50 user nova-compute[71325]:   <serial>4732c9ce-0873-4c34-82bd-aee4d8b249f8</serial>
Apr 13 21:57:50 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 21:57:50 user nova-compute[71325]: </disk>
Apr 13 21:57:50 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681423070.4186714, 68dbaff0-73ca-4caa-bd4f-f97065df4409 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:57:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Successfully detached device vdc from instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 from the live domain config.
Apr 13 21:57:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEMhpZSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:57:50 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f25522-8444-4481-a7e8-06a069e1d8fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:57:50 user nova-compute[71325]: No targets found.
Apr 13 21:57:50 user nova-compute[71325]: iSNS:
Apr 13 21:57:50 user nova-compute[71325]: No targets found.
Apr 13 21:57:50 user nova-compute[71325]: STATIC:
Apr 13 21:57:50 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8
Apr 13 21:57:50 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:50 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:50 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a
Apr 13 21:57:50 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:50 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:50 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:57:50 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:50 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:50 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808
Apr 13 21:57:50 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:50 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:50 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4
Apr 13 21:57:50 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:57:50 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:57:50 user nova-compute[71325]: FIRMWARE:
Apr 13 21:57:50 user nova-compute[71325]: No targets found.
Apr 13 21:57:50 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:57:50 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:57:50 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5becaf2d-b352-497b-b12c-69d7e2813b1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f893faba-7297-436e-b429-61fc2271fe60]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:50 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:50 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:50 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:50 user nova-compute[71325]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 (non-flash)
Apr 13 21:57:50 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:57:50 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:57:50 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:57:50 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:57:50 user nova-compute[71325]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 (non-flash)
Apr 13 21:57:50 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5cc197a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8'): ({'sdg'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Removing single pathed devices sdg {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb99548-8fa1-442d-8223-7832e36435da]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed22f094-2390-4f73-92ef-86c99c03640c]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flushing IO for device /dev/sdg {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce62bb86-b2ec-410d-874e-0ffcfe2ab9a2]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa545571-28d9-4451-9a8e-5005c6817d12]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] SCSI volumes sdg have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb50f9e-3600-485d-9c9a-8878da81230c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7606a42a-4fb2-477f-aaad-20afcffc649b]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8, portal: 172.16.0.220,3260]
Apr 13 21:57:50 user nova-compute[71325]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8, portal: 172.16.0.220,3260] successful.
Apr 13 21:57:50 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4732c9ce-0873-4c34-82bd-aee4d8b249f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b1a355-70c4-4517-adb9-58f096e90c48]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] <== disconnect_volume: return (338ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:57:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:57:51 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423056.2199616, 9c729f61-da40-49d7-8f93-d9bbe30fa877 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:57:51 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] VM Stopped (Lifecycle Event)
Apr 13 21:57:51 user nova-compute[71325]: DEBUG nova.compute.manager [None req-47fd346b-1877-41ef-9cf1-8f1c654ad7d1 None None] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:57:51 user nova-compute[71325]: DEBUG nova.objects.instance [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'flavor' on Instance uuid 68dbaff0-73ca-4caa-bd4f-f97065df4409 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.677s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:52 user nova-compute[71325]: INFO nova.compute.manager [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Terminating instance
Apr 13 21:57:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-55188c8e-2730-4f15-842d-6ffb0ab335d8 req-d155e926-876d-454d-9f40-1fce13d3b908 service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Received event network-vif-unplugged-281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-55188c8e-2730-4f15-842d-6ffb0ab335d8 req-d155e926-876d-454d-9f40-1fce13d3b908 service nova] Acquiring lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-55188c8e-2730-4f15-842d-6ffb0ab335d8 req-d155e926-876d-454d-9f40-1fce13d3b908 service nova] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-55188c8e-2730-4f15-842d-6ffb0ab335d8 req-d155e926-876d-454d-9f40-1fce13d3b908 service nova] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-55188c8e-2730-4f15-842d-6ffb0ab335d8 req-d155e926-876d-454d-9f40-1fce13d3b908 service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] No waiting events found dispatching network-vif-unplugged-281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-55188c8e-2730-4f15-842d-6ffb0ab335d8 req-d155e926-876d-454d-9f40-1fce13d3b908 service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Received event network-vif-unplugged-281f102d-de13-4548-a18c-3e452509c97c for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:57:53 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Instance destroyed successfully.
Apr 13 21:57:53 user nova-compute[71325]: DEBUG nova.objects.instance [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'resources' on Instance uuid 68dbaff0-73ca-4caa-bd4f-f97065df4409 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:57:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1947981713',display_name='tempest-AttachVolumeTestJSON-server-1947981713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1947981713',id=26,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGsNbk24v9gRwINKBHxnvwkpynX5ApVk07JfuyA5Y8CkVYfwSmGLiy3Yb85Bd5j3v3egJvdO0SGKRzUdcKUmZwBQQD/pQ4Siu2lstEO6sNPuVcdj1xLfaPETf+n2/dHlw==',key_name='tempest-keypair-1585186331',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:55:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3605d609b52b431993bcea0798a77554',ramdisk_id='',reservation_id='r-34oke2up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-249879422',owner_user_name='tempest-AttachVolumeTestJSON-249879422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:55:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60e4dadf9d9e41e6a91ee03a0cd50dc3',uuid=68dbaff0-73ca-4caa-bd4f-f97065df4409,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "281f102d-de13-4548-a18c-3e452509c97c", "address": "fa:16:3e:8d:19:2f", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281f102d-de", "ovs_interfaceid": "281f102d-de13-4548-a18c-3e452509c97c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:57:53 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converting VIF {"id": "281f102d-de13-4548-a18c-3e452509c97c", "address": "fa:16:3e:8d:19:2f", "network": {"id": "05504462-8db4-4453-90fd-55cfd765138e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-68429507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3605d609b52b431993bcea0798a77554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281f102d-de", "ovs_interfaceid": "281f102d-de13-4548-a18c-3e452509c97c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:57:53 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:19:2f,bridge_name='br-int',has_traffic_filtering=True,id=281f102d-de13-4548-a18c-3e452509c97c,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281f102d-de') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:57:53 user nova-compute[71325]: DEBUG os_vif [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:19:2f,bridge_name='br-int',has_traffic_filtering=True,id=281f102d-de13-4548-a18c-3e452509c97c,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281f102d-de') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:57:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap281f102d-de, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:57:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:57:53 user nova-compute[71325]: INFO os_vif [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:19:2f,bridge_name='br-int',has_traffic_filtering=True,id=281f102d-de13-4548-a18c-3e452509c97c,network=Network(05504462-8db4-4453-90fd-55cfd765138e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281f102d-de')
Apr 13 21:57:53 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Deleting instance files /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409_del
Apr 13 21:57:53 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Deletion of /opt/stack/data/nova/instances/68dbaff0-73ca-4caa-bd4f-f97065df4409_del complete
Apr 13 21:57:53 user nova-compute[71325]: INFO nova.compute.manager [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 13 21:57:53 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:57:53 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:57:53 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:57:54 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:57:54 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Took 0.71 seconds to deallocate network for instance.
Apr 13 21:57:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:54 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:57:54 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:57:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:54 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Deleted allocations for instance 68dbaff0-73ca-4caa-bd4f-f97065df4409
Apr 13 21:57:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.082s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-f9be7e86-40da-4c68-9d75-81c06b229bc0 req-c54dd212-cb55-4301-b394-1a612d260f69 service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Received event network-vif-plugged-281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f9be7e86-40da-4c68-9d75-81c06b229bc0 req-c54dd212-cb55-4301-b394-1a612d260f69 service nova] Acquiring lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:57:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f9be7e86-40da-4c68-9d75-81c06b229bc0 req-c54dd212-cb55-4301-b394-1a612d260f69 service nova] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:57:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f9be7e86-40da-4c68-9d75-81c06b229bc0 req-c54dd212-cb55-4301-b394-1a612d260f69 service nova] Lock "68dbaff0-73ca-4caa-bd4f-f97065df4409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:57:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-f9be7e86-40da-4c68-9d75-81c06b229bc0 req-c54dd212-cb55-4301-b394-1a612d260f69 service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] No waiting events found dispatching network-vif-plugged-281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:57:55 user nova-compute[71325]: WARNING nova.compute.manager [req-f9be7e86-40da-4c68-9d75-81c06b229bc0 req-c54dd212-cb55-4301-b394-1a612d260f69 service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Received unexpected event network-vif-plugged-281f102d-de13-4548-a18c-3e452509c97c for instance with vm_state deleted and task_state None.
Apr 13 21:57:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-f9be7e86-40da-4c68-9d75-81c06b229bc0 req-c54dd212-cb55-4301-b394-1a612d260f69 service nova] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Received event network-vif-deleted-281f102d-de13-4548-a18c-3e452509c97c {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:57:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:57:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "15a855b1-8253-4b57-b675-edeee6a91511" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "15a855b1-8253-4b57-b675-edeee6a91511" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:58:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:07 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:58:07 user nova-compute[71325]: INFO nova.compute.claims [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Claim successful on node user
Apr 13 21:58:08 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG nova.network.neutron [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:58:08 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:58:08 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423073.2732112, 68dbaff0-73ca-4caa-bd4f-f97065df4409 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:58:08 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] VM Stopped (Lifecycle Event)
Apr 13 21:58:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6e5cf474-2d0a-4357-8ed4-572b6db7ccf5 None None] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG nova.compute.manager [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:08 user nova-compute[71325]: INFO nova.virt.block_device [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Booting with volume 6eaa51d1-a9c7-4ca4-b76d-903304f71409 at /dev/vda
Apr 13 21:58:08 user nova-compute[71325]: DEBUG os_brick.utils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[40755c92-45db-4cc5-88df-212b406bf020]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a650a0be-5749-4b1a-9f24-1ff9b8c04958]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ec6564-3a81-4573-951c-ef14d181bceb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e3aa7d-f462-4a7a-9f54-75103f770551]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:58:08 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:58:08 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[794a12b4-12a1-4a79-b74f-1f9168f870de]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG os_brick.utils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Updating existing volume attachment record: 21e1eb9c-9aa0-41ff-aa72-efbfeb2a3863 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:58:08 user nova-compute[71325]: DEBUG nova.policy [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:58:09 user nova-compute[71325]: DEBUG nova.network.neutron [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Successfully created port: a9ff5635-bea0-434b-bdb6-4004eefa847a {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG nova.network.neutron [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Successfully updated port: a9ff5635-bea0-434b-bdb6-4004eefa847a {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "refresh_cache-15a855b1-8253-4b57-b675-edeee6a91511" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquired lock "refresh_cache-15a855b1-8253-4b57-b675-edeee6a91511" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG nova.network.neutron [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG nova.compute.manager [req-cad691d4-1df6-4a5a-84a3-4e4b6dc5578c req-6ebc77fb-fe42-467a-94cd-e483a22c79ad service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Received event network-changed-a9ff5635-bea0-434b-bdb6-4004eefa847a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG nova.compute.manager [req-cad691d4-1df6-4a5a-84a3-4e4b6dc5578c req-6ebc77fb-fe42-467a-94cd-e483a22c79ad service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Refreshing instance network info cache due to event network-changed-a9ff5635-bea0-434b-bdb6-4004eefa847a. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-cad691d4-1df6-4a5a-84a3-4e4b6dc5578c req-6ebc77fb-fe42-467a-94cd-e483a22c79ad service nova] Acquiring lock "refresh_cache-15a855b1-8253-4b57-b675-edeee6a91511" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG nova.network.neutron [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG nova.network.neutron [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Updating instance_info_cache with network_info: [{"id": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "address": "fa:16:3e:ae:cb:c7", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ff5635-be", "ovs_interfaceid": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Releasing lock "refresh_cache-15a855b1-8253-4b57-b675-edeee6a91511" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Instance network_info: |[{"id": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "address": "fa:16:3e:ae:cb:c7", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ff5635-be", "ovs_interfaceid": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-cad691d4-1df6-4a5a-84a3-4e4b6dc5578c req-6ebc77fb-fe42-467a-94cd-e483a22c79ad service nova] Acquired lock "refresh_cache-15a855b1-8253-4b57-b675-edeee6a91511" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG nova.network.neutron [req-cad691d4-1df6-4a5a-84a3-4e4b6dc5578c req-6ebc77fb-fe42-467a-94cd-e483a22c79ad service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Refreshing network info cache for port a9ff5635-bea0-434b-bdb6-4004eefa847a {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG nova.network.neutron [req-cad691d4-1df6-4a5a-84a3-4e4b6dc5578c req-6ebc77fb-fe42-467a-94cd-e483a22c79ad service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Updated VIF entry in instance network info cache for port a9ff5635-bea0-434b-bdb6-4004eefa847a. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG nova.network.neutron [req-cad691d4-1df6-4a5a-84a3-4e4b6dc5578c req-6ebc77fb-fe42-467a-94cd-e483a22c79ad service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Updating instance_info_cache with network_info: [{"id": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "address": "fa:16:3e:ae:cb:c7", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ff5635-be", "ovs_interfaceid": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:58:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-cad691d4-1df6-4a5a-84a3-4e4b6dc5578c req-6ebc77fb-fe42-467a-94cd-e483a22c79ad service nova] Releasing lock "refresh_cache-15a855b1-8253-4b57-b675-edeee6a91511" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:58:11 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Updating instance_info_cache with network_info: [{"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:58:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:58:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:58:11 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:58:11 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:58:11 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:58:12 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:58:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:58:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.compute.manager [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:58:13 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Creating image(s)
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Ensure instance console log exists: /opt/stack/data/nova/instances/15a855b1-8253-4b57-b675-edeee6a91511/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Start _get_guest_xml network_info=[{"id": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "address": "fa:16:3e:ae:cb:c7", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ff5635-be", "ovs_interfaceid": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgrbJmju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '15a855b1-8253-4b57-b675-edeee6a91511', 'attached_at': '', 'detached_at': '', 'volume_id': '6eaa51d1-a9c7-4ca4-b76d-903304f71409', 'serial': '6eaa51d1-a9c7-4ca4-b76d-903304f71409'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '21e1eb9c-9aa0-41ff-aa72-efbfeb2a3863', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:58:13 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgrbJmju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:58:13 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:58:13 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:58:13 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc8a59a-df85-4497-8ec4-8afa83b61cf9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:58:13 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1556411-1aba-41ff-a3f4-26a96276c04b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409] added
Apr 13 21:58:13 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c843a189-4fec-468b-986b-a19e6d99a3ea]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[da34ea00-4228-4ba1-a51e-7e528b7e3c21]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgrbJmju {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgrbJmju" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ea4bb9-f543-4875-ba4e-43bc3f3e422c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xgrbJmju'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13f5edb-866a-49ef-859f-88395684a1db]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e87dd24-0380-4112-8adc-e3c3fde4ec0e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:58:13 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:58:13 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:58:13 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:58:13 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:58:13 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:58:13 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:58:13 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:58:13 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[171c9d94-a9a6-438c-8299-e64d01a9463d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409, portal: 172.16.0.220,3260]
Apr 13 21:58:13 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409, portal: 172.16.0.220,3260] successful.
Apr 13 21:58:13 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a81c963-1dfe-47c0-bd74-10a2ecff9fce]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a52424-3a33-4b86-8178-6d211b653d6b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:58:13 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:58:13 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:58:13 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:58:13 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 21:58:13 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:58:13 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:58:13 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:58:13 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:58:13 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 21:58:13 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b641852-3332-4f1a-8f4a-115be6c0b534]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgrbJmju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '26339353163356232', 'path': '/dev/sdc'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339353163356232', 'path': '/dev/sdc'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:58:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-782768086',display_name='tempest-TestVolumeBootPattern-volume-backed-server-782768086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-782768086',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-68n6ymkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:58:08Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=15a855b1-8253-4b57-b675-edeee6a91511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "address": "fa:16:3e:ae:cb:c7", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ff5635-be", "ovs_interfaceid": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "address": "fa:16:3e:ae:cb:c7", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ff5635-be", "ovs_interfaceid": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cb:c7,bridge_name='br-int',has_traffic_filtering=True,id=a9ff5635-bea0-434b-bdb6-4004eefa847a,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ff5635-be') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG nova.objects.instance [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lazy-loading 'pci_devices' on Instance uuid 15a855b1-8253-4b57-b675-edeee6a91511 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:58:14 user nova-compute[71325]:   <uuid>15a855b1-8253-4b57-b675-edeee6a91511</uuid>
Apr 13 21:58:14 user nova-compute[71325]:   <name>instance-0000001e</name>
Apr 13 21:58:14 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:58:14 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:58:14 user nova-compute[71325]:   <metadata>
Apr 13 21:58:14 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:58:14 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:58:14 user nova-compute[71325]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-782768086</nova:name>
Apr 13 21:58:14 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:58:13</nova:creationTime>
Apr 13 21:58:14 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:58:14 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:58:14 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:58:14 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:58:14 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:58:14 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:58:14 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:58:14 user nova-compute[71325]:       <nova:owner>
Apr 13 21:58:14 user nova-compute[71325]:         <nova:user uuid="50a8a5f433c94e0c9ba4d6ecea37d756">tempest-TestVolumeBootPattern-1335483698-project-member</nova:user>
Apr 13 21:58:14 user nova-compute[71325]:         <nova:project uuid="ad824150d99044c6ab1c7829cbe01de5">tempest-TestVolumeBootPattern-1335483698</nova:project>
Apr 13 21:58:14 user nova-compute[71325]:       </nova:owner>
Apr 13 21:58:14 user nova-compute[71325]:       <nova:ports>
Apr 13 21:58:14 user nova-compute[71325]:         <nova:port uuid="a9ff5635-bea0-434b-bdb6-4004eefa847a">
Apr 13 21:58:14 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 21:58:14 user nova-compute[71325]:         </nova:port>
Apr 13 21:58:14 user nova-compute[71325]:       </nova:ports>
Apr 13 21:58:14 user nova-compute[71325]:     </nova:instance>
Apr 13 21:58:14 user nova-compute[71325]:   </metadata>
Apr 13 21:58:14 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:58:14 user nova-compute[71325]:     <system>
Apr 13 21:58:14 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:58:14 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:58:14 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:58:14 user nova-compute[71325]:       <entry name="serial">15a855b1-8253-4b57-b675-edeee6a91511</entry>
Apr 13 21:58:14 user nova-compute[71325]:       <entry name="uuid">15a855b1-8253-4b57-b675-edeee6a91511</entry>
Apr 13 21:58:14 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:58:14 user nova-compute[71325]:     </system>
Apr 13 21:58:14 user nova-compute[71325]:   </sysinfo>
Apr 13 21:58:14 user nova-compute[71325]:   <os>
Apr 13 21:58:14 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:58:14 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:58:14 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:58:14 user nova-compute[71325]:   </os>
Apr 13 21:58:14 user nova-compute[71325]:   <features>
Apr 13 21:58:14 user nova-compute[71325]:     <acpi/>
Apr 13 21:58:14 user nova-compute[71325]:     <apic/>
Apr 13 21:58:14 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:58:14 user nova-compute[71325]:   </features>
Apr 13 21:58:14 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:58:14 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:58:14 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:58:14 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:58:14 user nova-compute[71325]:   </clock>
Apr 13 21:58:14 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:58:14 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:58:14 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:58:14 user nova-compute[71325]:   </cpu>
Apr 13 21:58:14 user nova-compute[71325]:   <devices>
Apr 13 21:58:14 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:58:14 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:58:14 user nova-compute[71325]:       <source dev="/dev/sdc"/>
Apr 13 21:58:14 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:58:14 user nova-compute[71325]:       <serial>6eaa51d1-a9c7-4ca4-b76d-903304f71409</serial>
Apr 13 21:58:14 user nova-compute[71325]:     </disk>
Apr 13 21:58:14 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:58:14 user nova-compute[71325]:       <mac address="fa:16:3e:ae:cb:c7"/>
Apr 13 21:58:14 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:58:14 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:58:14 user nova-compute[71325]:       <target dev="tapa9ff5635-be"/>
Apr 13 21:58:14 user nova-compute[71325]:     </interface>
Apr 13 21:58:14 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:58:14 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/15a855b1-8253-4b57-b675-edeee6a91511/console.log" append="off"/>
Apr 13 21:58:14 user nova-compute[71325]:     </serial>
Apr 13 21:58:14 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:58:14 user nova-compute[71325]:     <video>
Apr 13 21:58:14 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:58:14 user nova-compute[71325]:     </video>
Apr 13 21:58:14 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:58:14 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:58:14 user nova-compute[71325]:     </rng>
Apr 13 21:58:14 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:58:14 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:58:14 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:58:14 user nova-compute[71325]:     </memballoon>
Apr 13 21:58:14 user nova-compute[71325]:   </devices>
Apr 13 21:58:14 user nova-compute[71325]: </domain>
Apr 13 21:58:14 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:58:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-782768086',display_name='tempest-TestVolumeBootPattern-volume-backed-server-782768086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-782768086',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-68n6ymkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:58:08Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=15a855b1-8253-4b57-b675-edeee6a91511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "address": "fa:16:3e:ae:cb:c7", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ff5635-be", "ovs_interfaceid": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "address": "fa:16:3e:ae:cb:c7", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ff5635-be", "ovs_interfaceid": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cb:c7,bridge_name='br-int',has_traffic_filtering=True,id=a9ff5635-bea0-434b-bdb6-4004eefa847a,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ff5635-be') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG os_vif [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cb:c7,bridge_name='br-int',has_traffic_filtering=True,id=a9ff5635-bea0-434b-bdb6-4004eefa847a,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ff5635-be') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9ff5635-be, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9ff5635-be, col_values=(('external_ids', {'iface-id': 'a9ff5635-bea0-434b-bdb6-4004eefa847a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:cb:c7', 'vm-uuid': '15a855b1-8253-4b57-b675-edeee6a91511'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:14 user nova-compute[71325]: INFO os_vif [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cb:c7,bridge_name='br-int',has_traffic_filtering=True,id=a9ff5635-bea0-434b-bdb6-4004eefa847a,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ff5635-be')
Apr 13 21:58:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] No VIF found with MAC fa:16:3e:ae:cb:c7, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:58:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423098.433404, 15a855b1-8253-4b57-b675-edeee6a91511 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:58:18 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] VM Resumed (Lifecycle Event)
Apr 13 21:58:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-0a52a449-22c1-4ac6-9d13-b427d02e9154 req-bd4e24e6-b8e4-419f-afaf-2326824f2cce service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Received event network-vif-plugged-a9ff5635-bea0-434b-bdb6-4004eefa847a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0a52a449-22c1-4ac6-9d13-b427d02e9154 req-bd4e24e6-b8e4-419f-afaf-2326824f2cce service nova] Acquiring lock "15a855b1-8253-4b57-b675-edeee6a91511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0a52a449-22c1-4ac6-9d13-b427d02e9154 req-bd4e24e6-b8e4-419f-afaf-2326824f2cce service nova] Lock "15a855b1-8253-4b57-b675-edeee6a91511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0a52a449-22c1-4ac6-9d13-b427d02e9154 req-bd4e24e6-b8e4-419f-afaf-2326824f2cce service nova] Lock "15a855b1-8253-4b57-b675-edeee6a91511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-0a52a449-22c1-4ac6-9d13-b427d02e9154 req-bd4e24e6-b8e4-419f-afaf-2326824f2cce service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] No waiting events found dispatching network-vif-plugged-a9ff5635-bea0-434b-bdb6-4004eefa847a {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:58:18 user nova-compute[71325]: WARNING nova.compute.manager [req-0a52a449-22c1-4ac6-9d13-b427d02e9154 req-bd4e24e6-b8e4-419f-afaf-2326824f2cce service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Received unexpected event network-vif-plugged-a9ff5635-bea0-434b-bdb6-4004eefa847a for instance with vm_state building and task_state spawning.
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-3d72d54b-1064-4cdc-ad87-074fba465233 req-15b1fc75-fc64-44e2-8ca7-5fad4c268b3d service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Received event network-vif-plugged-a9ff5635-bea0-434b-bdb6-4004eefa847a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3d72d54b-1064-4cdc-ad87-074fba465233 req-15b1fc75-fc64-44e2-8ca7-5fad4c268b3d service nova] Acquiring lock "15a855b1-8253-4b57-b675-edeee6a91511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3d72d54b-1064-4cdc-ad87-074fba465233 req-15b1fc75-fc64-44e2-8ca7-5fad4c268b3d service nova] Lock "15a855b1-8253-4b57-b675-edeee6a91511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3d72d54b-1064-4cdc-ad87-074fba465233 req-15b1fc75-fc64-44e2-8ca7-5fad4c268b3d service nova] Lock "15a855b1-8253-4b57-b675-edeee6a91511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-3d72d54b-1064-4cdc-ad87-074fba465233 req-15b1fc75-fc64-44e2-8ca7-5fad4c268b3d service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] No waiting events found dispatching network-vif-plugged-a9ff5635-bea0-434b-bdb6-4004eefa847a {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:58:18 user nova-compute[71325]: WARNING nova.compute.manager [req-3d72d54b-1064-4cdc-ad87-074fba465233 req-15b1fc75-fc64-44e2-8ca7-5fad4c268b3d service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Received unexpected event network-vif-plugged-a9ff5635-bea0-434b-bdb6-4004eefa847a for instance with vm_state building and task_state spawning.
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.compute.manager [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:18 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:58:18 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7593MB free_disk=26.07160186767578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:18 user nova-compute[71325]: INFO nova.compute.manager [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Terminating instance
Apr 13 21:58:18 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Instance spawned successfully.
Apr 13 21:58:18 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423098.4342082, 15a855b1-8253-4b57-b675-edeee6a91511 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:58:18 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] VM Started (Lifecycle Event)
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.compute.manager [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:58:18 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:58:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:19 user nova-compute[71325]: INFO nova.compute.manager [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Took 5.87 seconds to spawn the instance on the hypervisor.
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Applying migration context for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 as it has an incoming, in-progress migration 3ddfcd30-8fec-4291-95d8-7d3f164519d4. Migration status is finished {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 21:58:19 user nova-compute[71325]: INFO nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating resource usage from migration 3ddfcd30-8fec-4291-95d8-7d3f164519d4
Apr 13 21:58:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ef8a447a-cdcd-4a56-ad53-abe6d9951266 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Migration 3ddfcd30-8fec-4291-95d8-7d3f164519d4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance bfcfa307-25f3-43e0-837b-704b5cd7783f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 15a855b1-8253-4b57-b675-edeee6a91511 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=2112MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:58:19 user nova-compute[71325]: INFO nova.compute.manager [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Took 11.40 seconds to build instance.
Apr 13 21:58:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "15a855b1-8253-4b57-b675-edeee6a91511" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.496s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:19 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Instance destroyed successfully.
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'resources' on Instance uuid 2d1990a1-40ec-4c02-941f-813c22e8cd8f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1709500779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1709500779',id=21,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXhPPymVnGsGI8iPnkTaRKfPT/rUDm48QkxOPI6ZWHXQz9atCTXJ29rrIJZqJqbdFj0MEal6JqZMkPR7ZgeYnFdlqc8HBwjKnYEiOmGpjFVUDqtFqGBgnihI4QoBsFC8Q==',key_name='tempest-keypair-1268128451',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:56:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73c23bc3e8b14441b4622095502b5dae',ramdisk_id='',reservation_id='r-j68sz1ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-710815470',owner_user_name='tempest-AttachVolumeShelveTestJSON-710815470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f151b673e3d47acb9c3ed9b9ecaf687',uuid=2d1990a1-40ec-4c02-941f-813c22e8cd8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converting VIF {"id": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "address": "fa:16:3e:38:35:f3", "network": {"id": "ae194169-1c43-4713-9bac-e45364ca6179", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-214349110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73c23bc3e8b14441b4622095502b5dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596fdd61-68", "ovs_interfaceid": "596fdd61-68e0-4968-9d6a-e70d32a61ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:f3,bridge_name='br-int',has_traffic_filtering=True,id=596fdd61-68e0-4968-9d6a-e70d32a61ea1,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596fdd61-68') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG os_vif [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:f3,bridge_name='br-int',has_traffic_filtering=True,id=596fdd61-68e0-4968-9d6a-e70d32a61ea1,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596fdd61-68') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap596fdd61-68, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:58:19 user nova-compute[71325]: INFO os_vif [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:f3,bridge_name='br-int',has_traffic_filtering=True,id=596fdd61-68e0-4968-9d6a-e70d32a61ea1,network=Network(ae194169-1c43-4713-9bac-e45364ca6179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596fdd61-68')
Apr 13 21:58:19 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Deleting instance files /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f_del
Apr 13 21:58:19 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Deletion of /opt/stack/data/nova/instances/2d1990a1-40ec-4c02-941f-813c22e8cd8f_del complete
Apr 13 21:58:19 user nova-compute[71325]: INFO nova.compute.manager [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 13 21:58:19 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:58:19 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received event network-vif-unplugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] Acquiring lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] No waiting events found dispatching network-vif-unplugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received event network-vif-unplugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received event network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] Acquiring lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] No waiting events found dispatching network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:58:20 user nova-compute[71325]: WARNING nova.compute.manager [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received unexpected event network-vif-plugged-596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance with vm_state active and task_state deleting.
Apr 13 21:58:20 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:58:20 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Took 0.92 seconds to deallocate network for instance.
Apr 13 21:58:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:21 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:58:21 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:58:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:21 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Deleted allocations for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f
Apr 13 21:58:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "2d1990a1-40ec-4c02-941f-813c22e8cd8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.449s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-5958c634-f08d-448e-ad08-67ad4335ccfc req-e16d6c7b-426d-4fda-9f0f-10cdf1e7e1ef service nova] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Received event network-vif-deleted-596fdd61-68e0-4968-9d6a-e70d32a61ea1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:58:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:26 user nova-compute[71325]: INFO nova.compute.manager [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Detaching volume 314899e4-f6f0-4aba-a3cb-60eca54e6808
Apr 13 21:58:26 user nova-compute[71325]: INFO nova.virt.block_device [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Attempting to driver detach volume 314899e4-f6f0-4aba-a3cb-60eca54e6808 from mountpoint /dev/vdb
Apr 13 21:58:26 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Attempting to detach device vdb from instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:58:26 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:58:26 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:58:26 user nova-compute[71325]:   <source dev="/dev/sde"/>
Apr 13 21:58:26 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:58:26 user nova-compute[71325]:   <serial>314899e4-f6f0-4aba-a3cb-60eca54e6808</serial>
Apr 13 21:58:26 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:58:26 user nova-compute[71325]: </disk>
Apr 13 21:58:26 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:58:26 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Successfully detached device vdb from instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 from the persistent domain config.
Apr 13 21:58:26 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:58:26 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:58:26 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:58:26 user nova-compute[71325]:   <source dev="/dev/sde"/>
Apr 13 21:58:26 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:58:26 user nova-compute[71325]:   <serial>314899e4-f6f0-4aba-a3cb-60eca54e6808</serial>
Apr 13 21:58:26 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:58:26 user nova-compute[71325]: </disk>
Apr 13 21:58:26 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:58:26 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681423106.9943266, 78b584a2-7dbc-4793-9d93-37897f9a24b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:58:26 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:58:27 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Successfully detached device vdb from instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 from the live domain config.
Apr 13 21:58:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKhDWRlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:58:27 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8adac20-7890-4dc3-a8eb-c309fcb15f83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:58:27 user nova-compute[71325]: No targets found.
Apr 13 21:58:27 user nova-compute[71325]: iSNS:
Apr 13 21:58:27 user nova-compute[71325]: No targets found.
Apr 13 21:58:27 user nova-compute[71325]: STATIC:
Apr 13 21:58:27 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a
Apr 13 21:58:27 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:58:27 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:58:27 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:58:27 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:58:27 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:58:27 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409
Apr 13 21:58:27 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:58:27 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:58:27 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808
Apr 13 21:58:27 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:58:27 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:58:27 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4
Apr 13 21:58:27 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:58:27 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:58:27 user nova-compute[71325]: FIRMWARE:
Apr 13 21:58:27 user nova-compute[71325]: No targets found.
Apr 13 21:58:27 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:58:27 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:58:27 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eabcf1-2280-4fa4-b125-33e31a44c0a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[940ef673-175f-445a-ab29-fc4f1c3c05db]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:58:27 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:58:27 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:58:27 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:58:27 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 21:58:27 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:58:27 user nova-compute[71325]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 (non-flash)
Apr 13 21:58:27 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:58:27 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:58:27 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 21:58:27 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7ebe950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808'): ({'sde'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Removing single pathed devices sde {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4b9f7f-f208-4af0-92e8-8a1fa19c5216]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d585c28d-a45a-49a9-af14-d01c36a069b4]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flushing IO for device /dev/sde {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36216eb-ea90-49c4-b224-c60df941534f]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[911f43db-35d0-49ad-afb3-42210683b662]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] SCSI volumes sde have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a409dfea-99ab-41db-885b-402aa121785a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b80beb-9bf9-4899-b4ac-a39f78eef71c]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808, portal: 172.16.0.220,3260]
Apr 13 21:58:27 user nova-compute[71325]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808, portal: 172.16.0.220,3260] successful.
Apr 13 21:58:27 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314899e4-f6f0-4aba-a3cb-60eca54e6808 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e28d0e-03e8-42a1-bace-35bc18a2b2d0]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] <== disconnect_volume: return (324ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:58:27 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:58:28 user nova-compute[71325]: DEBUG nova.objects.instance [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'flavor' on Instance uuid 78b584a2-7dbc-4793-9d93-37897f9a24b1 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:58:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.795s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:34 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423099.6761467, 2d1990a1-40ec-4c02-941f-813c22e8cd8f => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:58:34 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] VM Stopped (Lifecycle Event)
Apr 13 21:58:34 user nova-compute[71325]: DEBUG nova.compute.manager [None req-f78b01c2-8676-46ec-bc8c-bf6538bb454a None None] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:58:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:42 user nova-compute[71325]: INFO nova.compute.manager [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Terminating instance
Apr 13 21:58:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:58:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-daf5caa9-1b12-435d-85ae-5e354c465e05 req-80ed22c0-27f2-43de-bb61-f1924b150d00 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Received event network-vif-unplugged-24413127-af01-4371-9639-0f41979b91fb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:58:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-daf5caa9-1b12-435d-85ae-5e354c465e05 req-80ed22c0-27f2-43de-bb61-f1924b150d00 service nova] Acquiring lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-daf5caa9-1b12-435d-85ae-5e354c465e05 req-80ed22c0-27f2-43de-bb61-f1924b150d00 service nova] Lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-daf5caa9-1b12-435d-85ae-5e354c465e05 req-80ed22c0-27f2-43de-bb61-f1924b150d00 service nova] Lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-daf5caa9-1b12-435d-85ae-5e354c465e05 req-80ed22c0-27f2-43de-bb61-f1924b150d00 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] No waiting events found dispatching network-vif-unplugged-24413127-af01-4371-9639-0f41979b91fb {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:58:42 user nova-compute[71325]: DEBUG nova.compute.manager [req-daf5caa9-1b12-435d-85ae-5e354c465e05 req-80ed22c0-27f2-43de-bb61-f1924b150d00 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Received event network-vif-unplugged-24413127-af01-4371-9639-0f41979b91fb for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:58:43 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Instance destroyed successfully.
Apr 13 21:58:43 user nova-compute[71325]: DEBUG nova.objects.instance [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lazy-loading 'resources' on Instance uuid ef8a447a-cdcd-4a56-ad53-abe6d9951266 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:58:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2002337095',display_name='tempest-VolumesActionsTest-instance-2002337095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2002337095',id=28,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:56:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efd2e9bf0c5345f6bd3f030fb9f55e03',ramdisk_id='',reservation_id='r-zh9jq7lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1838938247',owner_user_name='tempest-VolumesActionsTest-1838938247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:56:58Z,user_data=None,user_id='9fe6b951236f4a96a2ac12a5dea4602a',uuid=ef8a447a-cdcd-4a56-ad53-abe6d9951266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24413127-af01-4371-9639-0f41979b91fb", "address": "fa:16:3e:77:6b:3e", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24413127-af", "ovs_interfaceid": "24413127-af01-4371-9639-0f41979b91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:58:43 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Converting VIF {"id": "24413127-af01-4371-9639-0f41979b91fb", "address": "fa:16:3e:77:6b:3e", "network": {"id": "dd758252-0db3-4d47-a231-c8a85e067e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-445883104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "efd2e9bf0c5345f6bd3f030fb9f55e03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24413127-af", "ovs_interfaceid": "24413127-af01-4371-9639-0f41979b91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:58:43 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:6b:3e,bridge_name='br-int',has_traffic_filtering=True,id=24413127-af01-4371-9639-0f41979b91fb,network=Network(dd758252-0db3-4d47-a231-c8a85e067e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24413127-af') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:58:43 user nova-compute[71325]: DEBUG os_vif [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6b:3e,bridge_name='br-int',has_traffic_filtering=True,id=24413127-af01-4371-9639-0f41979b91fb,network=Network(dd758252-0db3-4d47-a231-c8a85e067e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24413127-af') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:58:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24413127-af, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:58:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:58:43 user nova-compute[71325]: INFO os_vif [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6b:3e,bridge_name='br-int',has_traffic_filtering=True,id=24413127-af01-4371-9639-0f41979b91fb,network=Network(dd758252-0db3-4d47-a231-c8a85e067e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24413127-af')
Apr 13 21:58:43 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Deleting instance files /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266_del
Apr 13 21:58:43 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Deletion of /opt/stack/data/nova/instances/ef8a447a-cdcd-4a56-ad53-abe6d9951266_del complete
Apr 13 21:58:43 user nova-compute[71325]: INFO nova.compute.manager [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 13 21:58:43 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:58:43 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:58:43 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:58:44 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:58:44 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Took 0.77 seconds to deallocate network for instance.
Apr 13 21:58:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-e2f5cab7-eb73-4c40-abae-e46bbd868c7a req-f1ecba04-41cc-44c0-aa53-8c3cf0d8a9d9 service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Received event network-vif-deleted-24413127-af01-4371-9639-0f41979b91fb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:58:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:44 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:58:44 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:58:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:44 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Deleted allocations for instance ef8a447a-cdcd-4a56-ad53-abe6d9951266
Apr 13 21:58:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.987s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-85295084-3c66-4039-9f34-50e8d73d6e3f req-115fbd79-a8df-439a-9202-c2ae6d385e2b service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Received event network-vif-plugged-24413127-af01-4371-9639-0f41979b91fb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:58:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-85295084-3c66-4039-9f34-50e8d73d6e3f req-115fbd79-a8df-439a-9202-c2ae6d385e2b service nova] Acquiring lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:58:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-85295084-3c66-4039-9f34-50e8d73d6e3f req-115fbd79-a8df-439a-9202-c2ae6d385e2b service nova] Lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:58:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-85295084-3c66-4039-9f34-50e8d73d6e3f req-115fbd79-a8df-439a-9202-c2ae6d385e2b service nova] Lock "ef8a447a-cdcd-4a56-ad53-abe6d9951266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:58:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-85295084-3c66-4039-9f34-50e8d73d6e3f req-115fbd79-a8df-439a-9202-c2ae6d385e2b service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] No waiting events found dispatching network-vif-plugged-24413127-af01-4371-9639-0f41979b91fb {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:58:44 user nova-compute[71325]: WARNING nova.compute.manager [req-85295084-3c66-4039-9f34-50e8d73d6e3f req-115fbd79-a8df-439a-9202-c2ae6d385e2b service nova] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Received unexpected event network-vif-plugged-24413127-af01-4371-9639-0f41979b91fb for instance with vm_state deleted and task_state None.
Apr 13 21:58:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:58:58 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423123.195371, ef8a447a-cdcd-4a56-ad53-abe6d9951266 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:58:58 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] VM Stopped (Lifecycle Event)
Apr 13 21:58:58 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c7d25663-e90e-4d2f-8f1b-f75d6fa09b92 None None] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:58:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:03 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Port 03480082-c22f-4ad9-bc15-d536f115ec88 binding to destination host user is already ACTIVE {{(pid=71325) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 21:59:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:59:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquired lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:59:03 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:59:04 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating instance_info_cache with network_info: [{"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:59:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Releasing lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:59:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Creating tmpfile /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/tmp_82_z10v to verify with other compute node that the instance is on the same shared storage. {{(pid=71325) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 13 21:59:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:04 user nova-compute[71325]: DEBUG nova.compute.manager [req-cfd27d70-8e89-47f8-b188-509ff57c35e5 req-b350a842-8ab9-4cd1-9e06-0b46299e4d71 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-unplugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:59:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-cfd27d70-8e89-47f8-b188-509ff57c35e5 req-b350a842-8ab9-4cd1-9e06-0b46299e4d71 service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:59:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-cfd27d70-8e89-47f8-b188-509ff57c35e5 req-b350a842-8ab9-4cd1-9e06-0b46299e4d71 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:59:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-cfd27d70-8e89-47f8-b188-509ff57c35e5 req-b350a842-8ab9-4cd1-9e06-0b46299e4d71 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:59:04 user nova-compute[71325]: DEBUG nova.compute.manager [req-cfd27d70-8e89-47f8-b188-509ff57c35e5 req-b350a842-8ab9-4cd1-9e06-0b46299e4d71 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-unplugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:59:04 user nova-compute[71325]: WARNING nova.compute.manager [req-cfd27d70-8e89-47f8-b188-509ff57c35e5 req-b350a842-8ab9-4cd1-9e06-0b46299e4d71 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-unplugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state resized and task_state resize_reverting.
Apr 13 21:59:05 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance destroyed successfully.
Apr 13 21:59:05 user nova-compute[71325]: DEBUG nova.objects.instance [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'resources' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-968149372',display_name='tempest-ServerActionsTestJSON-server-1348347503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-968149372',id=14,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-p35kb61w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:57:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=c895d9cf-e6c1-42d6-88e3-1209b203fbe3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_vif [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03480082-c2, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:59:05 user nova-compute[71325]: INFO os_vif [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2')
Apr 13 21:59:05 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBajDAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:59:05 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c31025-0701-440a-ada1-c0b3c3ed6bbb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:59:05 user nova-compute[71325]: No targets found.
Apr 13 21:59:05 user nova-compute[71325]: iSNS:
Apr 13 21:59:05 user nova-compute[71325]: No targets found.
Apr 13 21:59:05 user nova-compute[71325]: STATIC:
Apr 13 21:59:05 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a
Apr 13 21:59:05 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:59:05 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:59:05 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:59:05 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:59:05 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:59:05 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409
Apr 13 21:59:05 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:59:05 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:59:05 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4
Apr 13 21:59:05 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:59:05 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:59:05 user nova-compute[71325]: FIRMWARE:
Apr 13 21:59:05 user nova-compute[71325]: No targets found.
Apr 13 21:59:05 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:59:05 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:59:05 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46717a6-6a3e-4c89-8cca-1e40e83a12ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4090e7-847f-4d55-9ed2-bbce477acf19]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:59:05 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:59:05 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:59:05 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 21:59:05 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:59:05 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:59:05 user nova-compute[71325]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:59:05 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 21:59:05 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5cc1bd990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe327f7-f228-4783-a426-c1bebb59373a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbb8d2d-1b66-4b28-b8e8-721a04fc9b0b]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dbd3fc-51af-4781-bc52-3cb60fc1ed22]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad67f2d-362b-4eb9-b5ce-f64c6ca7b3aa]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e4e6dd-b705-474e-8ed5-b4710fc02cbf]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[09371e9f-12cf-4b88-9789-1682e3587a23]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260]
Apr 13 21:59:05 user nova-compute[71325]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260] successful.
Apr 13 21:59:05 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf15f32-35e1-482e-903f-53ceff78f651]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== disconnect_volume: return (346ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:59:05 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:59:07 user nova-compute[71325]: DEBUG nova.compute.manager [req-79bd2625-2296-46fa-9f12-dfac214e7125 req-206e1c72-c02e-42cd-a807-93c44f573ce4 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:59:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-79bd2625-2296-46fa-9f12-dfac214e7125 req-206e1c72-c02e-42cd-a807-93c44f573ce4 service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:59:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-79bd2625-2296-46fa-9f12-dfac214e7125 req-206e1c72-c02e-42cd-a807-93c44f573ce4 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:59:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-79bd2625-2296-46fa-9f12-dfac214e7125 req-206e1c72-c02e-42cd-a807-93c44f573ce4 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:59:07 user nova-compute[71325]: DEBUG nova.compute.manager [req-79bd2625-2296-46fa-9f12-dfac214e7125 req-206e1c72-c02e-42cd-a807-93c44f573ce4 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:59:07 user nova-compute[71325]: WARNING nova.compute.manager [req-79bd2625-2296-46fa-9f12-dfac214e7125 req-206e1c72-c02e-42cd-a807-93c44f573ce4 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state resized and task_state resize_reverting.
Apr 13 21:59:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:59:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:59:07 user nova-compute[71325]: DEBUG nova.objects.instance [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'migration_context' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:59:07 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:59:07 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:59:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.415s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:59:08 user nova-compute[71325]: INFO nova.compute.manager [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Swapping old allocation on dict_keys(['2eb44a42-41ff-4980-ae1c-f21099638e55']) held by migration 3ddfcd30-8fec-4291-95d8-7d3f164519d4 for instance
Apr 13 21:59:08 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Overwriting current allocation {'allocations': {'2eb44a42-41ff-4980-ae1c-f21099638e55': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 36}}, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'consumer_generation': 1} on consumer c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 13 21:59:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:59:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquired lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:59:08 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating instance_info_cache with network_info: [{"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Releasing lock "refresh_cache-c895d9cf-e6c1-42d6-88e3-1209b203fbe3" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG os_brick.utils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd2f79a-f110-4a60-bf48-9c8337c84154]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cca857b-88c9-4fad-9992-31e92f249f5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ec9b71-bc39-4adf-9ffe-c710696d5031]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aa1b4d-b4c6-4c3a-bd27-c8681a9b8034]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:59:09 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:59:09 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9cf360-4b34-46f3-b5cd-a831e901e38b]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:59:09 user nova-compute[71325]: DEBUG os_brick.utils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:59:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:10 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:59:11 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:59:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:59:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Didn't find any instances for network info cache update. {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 21:59:11 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:59:12 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:59:12 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:59:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:59:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:59:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:59:12 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:59:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Starting finish_revert_migration {{(pid=71325) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Start _get_guest_xml network_info=[{"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBajDAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c895d9cf-e6c1-42d6-88e3-1209b203fbe3', 'attached_at': '2023-04-13T21:59:14.000000', 'detached_at': '', 'volume_id': '026beb94-6220-4541-8c6b-3296ae986d4a', 'serial': '026beb94-6220-4541-8c6b-3296ae986d4a'}, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '5083c163-de73-4209-99e3-a33d31267808', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:59:13 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:59:13 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:59:13 user nova-compute[71325]: DEBUG nova.objects.instance [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'vcpu_model' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBajDAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:59:14 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:59:14 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:59:14 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df3e9df-458d-48a0-9e86-3322e9de7fa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:59:14 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5cb4b3-bff6-4737-ae6a-2c4336108de6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a] added
Apr 13 21:59:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e143f9a-511f-4b96-83ef-20c5d1e76bca]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb4452a-4441-4a9f-8e2b-787d81335aae]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBajDAYp {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBajDAYp" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[119257cf-734e-4f75-a925-a46a1f1674f8]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XBajDAYp'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e9d787-195a-432c-ac4c-23396fa1a0da]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3cf8af-ce5e-42a0-bc84-d9fbd68e4c50]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:59:14 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:59:14 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 21:59:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:59:14 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:59:14 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 21:59:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc23a47a-a1e8-47c6-a313-5dace072680b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260]
Apr 13 21:59:14 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260] successful.
Apr 13 21:59:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[500b93e0-29e7-4a19-9d16-5ffac0994865]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[29766818-c7ac-4011-ae9c-0fcdcb0f3672]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:59:14 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:59:14 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 21:59:14 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:59:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:59:14 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:59:14 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 21:59:14 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:59:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2384fb8-36c6-42f6-a949-48c3ea516a9c]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBajDAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== connect_volume: return (1468ms) {'type': 'block', 'scsi_wwn': '23432336236313934', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432336236313934', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:59:15 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:59:15 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7907MB free_disk=26.13528823852539GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-968149372',display_name='tempest-ServerActionsTestJSON-server-1348347503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-968149372',id=14,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-p35kb61w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:59:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=c895d9cf-e6c1-42d6-88e3-1209b203fbe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:59:15 user nova-compute[71325]:   <uuid>c895d9cf-e6c1-42d6-88e3-1209b203fbe3</uuid>
Apr 13 21:59:15 user nova-compute[71325]:   <name>instance-0000000e</name>
Apr 13 21:59:15 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 21:59:15 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 21:59:15 user nova-compute[71325]:   <metadata>
Apr 13 21:59:15 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:59:15 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 21:59:15 user nova-compute[71325]:       <nova:name>tempest-ServerActionsTestJSON-server-1348347503</nova:name>
Apr 13 21:59:15 user nova-compute[71325]:       <nova:creationTime>2023-04-13 21:59:13</nova:creationTime>
Apr 13 21:59:15 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 21:59:15 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 21:59:15 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 21:59:15 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 21:59:15 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:59:15 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:59:15 user nova-compute[71325]:       </nova:flavor>
Apr 13 21:59:15 user nova-compute[71325]:       <nova:owner>
Apr 13 21:59:15 user nova-compute[71325]:         <nova:user uuid="b3db8b01a05b43f68bfd8695253514db">tempest-ServerActionsTestJSON-236976022-project-member</nova:user>
Apr 13 21:59:15 user nova-compute[71325]:         <nova:project uuid="7c086cffbafb4da68f172ab27da232d3">tempest-ServerActionsTestJSON-236976022</nova:project>
Apr 13 21:59:15 user nova-compute[71325]:       </nova:owner>
Apr 13 21:59:15 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 21:59:15 user nova-compute[71325]:       <nova:ports>
Apr 13 21:59:15 user nova-compute[71325]:         <nova:port uuid="03480082-c22f-4ad9-bc15-d536f115ec88">
Apr 13 21:59:15 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 21:59:15 user nova-compute[71325]:         </nova:port>
Apr 13 21:59:15 user nova-compute[71325]:       </nova:ports>
Apr 13 21:59:15 user nova-compute[71325]:     </nova:instance>
Apr 13 21:59:15 user nova-compute[71325]:   </metadata>
Apr 13 21:59:15 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 21:59:15 user nova-compute[71325]:     <system>
Apr 13 21:59:15 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:59:15 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:59:15 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 21:59:15 user nova-compute[71325]:       <entry name="serial">c895d9cf-e6c1-42d6-88e3-1209b203fbe3</entry>
Apr 13 21:59:15 user nova-compute[71325]:       <entry name="uuid">c895d9cf-e6c1-42d6-88e3-1209b203fbe3</entry>
Apr 13 21:59:15 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:59:15 user nova-compute[71325]:     </system>
Apr 13 21:59:15 user nova-compute[71325]:   </sysinfo>
Apr 13 21:59:15 user nova-compute[71325]:   <os>
Apr 13 21:59:15 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:59:15 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 21:59:15 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 21:59:15 user nova-compute[71325]:   </os>
Apr 13 21:59:15 user nova-compute[71325]:   <features>
Apr 13 21:59:15 user nova-compute[71325]:     <acpi/>
Apr 13 21:59:15 user nova-compute[71325]:     <apic/>
Apr 13 21:59:15 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 21:59:15 user nova-compute[71325]:   </features>
Apr 13 21:59:15 user nova-compute[71325]:   <clock offset="utc">
Apr 13 21:59:15 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:59:15 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:59:15 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 21:59:15 user nova-compute[71325]:   </clock>
Apr 13 21:59:15 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 21:59:15 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 21:59:15 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:59:15 user nova-compute[71325]:   </cpu>
Apr 13 21:59:15 user nova-compute[71325]:   <devices>
Apr 13 21:59:15 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 21:59:15 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:59:15 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk"/>
Apr 13 21:59:15 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 21:59:15 user nova-compute[71325]:     </disk>
Apr 13 21:59:15 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 21:59:15 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:59:15 user nova-compute[71325]:       <source dev="/dev/sdb"/>
Apr 13 21:59:15 user nova-compute[71325]:       <target dev="vdb" bus="virtio"/>
Apr 13 21:59:15 user nova-compute[71325]:       <serial>026beb94-6220-4541-8c6b-3296ae986d4a</serial>
Apr 13 21:59:15 user nova-compute[71325]:     </disk>
Apr 13 21:59:15 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 21:59:15 user nova-compute[71325]:       <mac address="fa:16:3e:ef:31:9d"/>
Apr 13 21:59:15 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:59:15 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 21:59:15 user nova-compute[71325]:       <target dev="tap03480082-c2"/>
Apr 13 21:59:15 user nova-compute[71325]:     </interface>
Apr 13 21:59:15 user nova-compute[71325]:     <serial type="pty">
Apr 13 21:59:15 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/console.log" append="off"/>
Apr 13 21:59:15 user nova-compute[71325]:     </serial>
Apr 13 21:59:15 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:59:15 user nova-compute[71325]:     <video>
Apr 13 21:59:15 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 21:59:15 user nova-compute[71325]:     </video>
Apr 13 21:59:15 user nova-compute[71325]:     <rng model="virtio">
Apr 13 21:59:15 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:59:15 user nova-compute[71325]:     </rng>
Apr 13 21:59:15 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:59:15 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 21:59:15 user nova-compute[71325]:       <stats period="10"/>
Apr 13 21:59:15 user nova-compute[71325]:     </memballoon>
Apr 13 21:59:15 user nova-compute[71325]:   </devices>
Apr 13 21:59:15 user nova-compute[71325]: </domain>
Apr 13 21:59:15 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-968149372',display_name='tempest-ServerActionsTestJSON-server-1348347503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-968149372',id=14,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-p35kb61w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:59:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=c895d9cf-e6c1-42d6-88e3-1209b203fbe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG os_vif [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03480082-c2, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03480082-c2, col_values=(('external_ids', {'iface-id': '03480082-c22f-4ad9-bc15-d536f115ec88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:31:9d', 'vm-uuid': 'c895d9cf-e6c1-42d6-88e3-1209b203fbe3'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:15 user nova-compute[71325]: INFO os_vif [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2')
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance bfcfa307-25f3-43e0-837b-704b5cd7783f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 15a855b1-8253-4b57-b675-edeee6a91511 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:59:15 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:59:16 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:59:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:59:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:59:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:59:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:59:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:59:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:59:16 user nova-compute[71325]: INFO nova.compute.manager [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Terminating instance
Apr 13 21:59:16 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-4cc90494-50d4-4a14-acf8-c176aa2dab07 req-daf88f41-87e4-45bc-b763-5193a4bb101e service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Received event network-vif-unplugged-1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4cc90494-50d4-4a14-acf8-c176aa2dab07 req-daf88f41-87e4-45bc-b763-5193a4bb101e service nova] Acquiring lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4cc90494-50d4-4a14-acf8-c176aa2dab07 req-daf88f41-87e4-45bc-b763-5193a4bb101e service nova] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4cc90494-50d4-4a14-acf8-c176aa2dab07 req-daf88f41-87e4-45bc-b763-5193a4bb101e service nova] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-4cc90494-50d4-4a14-acf8-c176aa2dab07 req-daf88f41-87e4-45bc-b763-5193a4bb101e service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] No waiting events found dispatching network-vif-unplugged-1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-4cc90494-50d4-4a14-acf8-c176aa2dab07 req-daf88f41-87e4-45bc-b763-5193a4bb101e service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Received event network-vif-unplugged-1d9d691f-bf56-4916-9d1d-422be2299247 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:59:17 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Instance destroyed successfully.
Apr 13 21:59:17 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'resources' on Instance uuid 78b584a2-7dbc-4793-9d93-37897f9a24b1 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1694878634',display_name='tempest-AttachVolumeNegativeTest-server-1694878634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1694878634',id=22,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKJiqdp3UBkP4HWGZ5pWWYRJwdY0AOytmb2C1U8rxnqJI+4BzVnFyxZoE6lJ7BrL1WIxSTz0CI4SBaf/l6Xft8tRo7bYgdhhDCuyQIZN1/utqRkjzxMGWh3aakpxsff6Q==',key_name='tempest-keypair-130014745',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:53:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='446b51db737947ab9bddd5fc47488bc7',ramdisk_id='',reservation_id='r-my0gt2j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-920375840',owner_user_name='tempest-AttachVolumeNegativeTest-920375840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145c0a177fcc4b94b5480d8806554ac9',uuid=78b584a2-7dbc-4793-9d93-37897f9a24b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d9d691f-bf56-4916-9d1d-422be2299247", "address": "fa:16:3e:54:e6:ae", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d9d691f-bf", "ovs_interfaceid": "1d9d691f-bf56-4916-9d1d-422be2299247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converting VIF {"id": "1d9d691f-bf56-4916-9d1d-422be2299247", "address": "fa:16:3e:54:e6:ae", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d9d691f-bf", "ovs_interfaceid": "1d9d691f-bf56-4916-9d1d-422be2299247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:e6:ae,bridge_name='br-int',has_traffic_filtering=True,id=1d9d691f-bf56-4916-9d1d-422be2299247,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d9d691f-bf') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG os_vif [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:e6:ae,bridge_name='br-int',has_traffic_filtering=True,id=1d9d691f-bf56-4916-9d1d-422be2299247,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d9d691f-bf') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d9d691f-bf, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:59:17 user nova-compute[71325]: INFO os_vif [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:e6:ae,bridge_name='br-int',has_traffic_filtering=True,id=1d9d691f-bf56-4916-9d1d-422be2299247,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d9d691f-bf')
Apr 13 21:59:17 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Deleting instance files /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1_del
Apr 13 21:59:17 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Deletion of /opt/stack/data/nova/instances/78b584a2-7dbc-4793-9d93-37897f9a24b1_del complete
Apr 13 21:59:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:17 user nova-compute[71325]: INFO nova.compute.manager [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Took 1.02 seconds to destroy the instance on the hypervisor.
Apr 13 21:59:17 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:59:17 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:59:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:18 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:59:18 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:59:18 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:59:18 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:59:18 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Took 0.99 seconds to deallocate network for instance.
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-be56ce21-bdd5-470f-b571-382cb4da9390 req-40784a67-aebb-4822-82d0-8c4f4a227585 service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Received event network-vif-deleted-1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:19 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Deleted allocations for instance 78b584a2-7dbc-4793-9d93-37897f9a24b1
Apr 13 21:59:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.553s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for c895d9cf-e6c1-42d6-88e3-1209b203fbe3 due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423159.6356764, c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:59:19 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] VM Resumed (Lifecycle Event)
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:59:19 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance running successfully.
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] finish_revert_migration finished successfully. {{(pid=71325) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:59:19 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423159.6371968, c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:59:19 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] VM Started (Lifecycle Event)
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:59:19 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Received event network-vif-plugged-1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Acquiring lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Lock "78b584a2-7dbc-4793-9d93-37897f9a24b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] No waiting events found dispatching network-vif-plugged-1d9d691f-bf56-4916-9d1d-422be2299247 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:59:19 user nova-compute[71325]: WARNING nova.compute.manager [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Received unexpected event network-vif-plugged-1d9d691f-bf56-4916-9d1d-422be2299247 for instance with vm_state deleted and task_state None.
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:59:19 user nova-compute[71325]: WARNING nova.compute.manager [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state resized and task_state resize_reverting.
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:59:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:59:19 user nova-compute[71325]: WARNING nova.compute.manager [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state resized and task_state resize_reverting.
Apr 13 21:59:19 user nova-compute[71325]: INFO nova.compute.manager [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating instance to original state: 'active'
Apr 13 21:59:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:59:20 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:59:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:25 user nova-compute[71325]: DEBUG nova.compute.manager [req-608c3445-12c9-4371-8a62-23f0cf942336 req-06f47a8d-7465-4b57-a08f-e748ef8cb304 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-changed-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:59:25 user nova-compute[71325]: DEBUG nova.compute.manager [req-608c3445-12c9-4371-8a62-23f0cf942336 req-06f47a8d-7465-4b57-a08f-e748ef8cb304 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Refreshing instance network info cache due to event network-changed-a438af72-b7ff-4ab6-82f5-59cf460c430f. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:59:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-608c3445-12c9-4371-8a62-23f0cf942336 req-06f47a8d-7465-4b57-a08f-e748ef8cb304 service nova] Acquiring lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:59:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-608c3445-12c9-4371-8a62-23f0cf942336 req-06f47a8d-7465-4b57-a08f-e748ef8cb304 service nova] Acquired lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:59:25 user nova-compute[71325]: DEBUG nova.network.neutron [req-608c3445-12c9-4371-8a62-23f0cf942336 req-06f47a8d-7465-4b57-a08f-e748ef8cb304 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Refreshing network info cache for port a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:59:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:59:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:59:25 user nova-compute[71325]: INFO nova.compute.manager [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Detaching volume 0a3bb043-64a5-42ac-afa3-e4f0896f84d4
Apr 13 21:59:25 user nova-compute[71325]: INFO nova.virt.block_device [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Attempting to driver detach volume 0a3bb043-64a5-42ac-afa3-e4f0896f84d4 from mountpoint /dev/vdb
Apr 13 21:59:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Attempting to detach device vdb from instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 21:59:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:59:25 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:59:25 user nova-compute[71325]:   <source dev="/dev/sdf"/>
Apr 13 21:59:25 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:59:25 user nova-compute[71325]:   <serial>0a3bb043-64a5-42ac-afa3-e4f0896f84d4</serial>
Apr 13 21:59:25 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:59:25 user nova-compute[71325]: </disk>
Apr 13 21:59:25 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:59:25 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Successfully detached device vdb from instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 from the persistent domain config.
Apr 13 21:59:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 21:59:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 21:59:25 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:59:25 user nova-compute[71325]:   <source dev="/dev/sdf"/>
Apr 13 21:59:25 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 21:59:25 user nova-compute[71325]:   <serial>0a3bb043-64a5-42ac-afa3-e4f0896f84d4</serial>
Apr 13 21:59:25 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 21:59:25 user nova-compute[71325]: </disk>
Apr 13 21:59:25 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 21:59:25 user nova-compute[71325]: DEBUG nova.network.neutron [req-608c3445-12c9-4371-8a62-23f0cf942336 req-06f47a8d-7465-4b57-a08f-e748ef8cb304 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Updated VIF entry in instance network info cache for port a438af72-b7ff-4ab6-82f5-59cf460c430f. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:59:25 user nova-compute[71325]: DEBUG nova.network.neutron [req-608c3445-12c9-4371-8a62-23f0cf942336 req-06f47a8d-7465-4b57-a08f-e748ef8cb304 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Updating instance_info_cache with network_info: [{"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:59:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-608c3445-12c9-4371-8a62-23f0cf942336 req-06f47a8d-7465-4b57-a08f-e748ef8cb304 service nova] Releasing lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:59:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681423165.996267, b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 21:59:26 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Successfully detached device vdb from instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 from the live domain config.
Apr 13 21:59:26 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fYRZoaFM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:59:26 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b80e5f-6bde-4bc2-8f9d-6d8b49e7ea8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:59:26 user nova-compute[71325]: No targets found.
Apr 13 21:59:26 user nova-compute[71325]: iSNS:
Apr 13 21:59:26 user nova-compute[71325]: No targets found.
Apr 13 21:59:26 user nova-compute[71325]: STATIC:
Apr 13 21:59:26 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a
Apr 13 21:59:26 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:59:26 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:59:26 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 21:59:26 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:59:26 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:59:26 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409
Apr 13 21:59:26 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:59:26 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:59:26 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4
Apr 13 21:59:26 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:59:26 user nova-compute[71325]:                 Iface Name: default
Apr 13 21:59:26 user nova-compute[71325]: FIRMWARE:
Apr 13 21:59:26 user nova-compute[71325]: No targets found.
Apr 13 21:59:26 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:59:26 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:59:26 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[451eda41-3fb2-458e-b9fc-eb07502e4823]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e918996-88ae-4ad0-bbb0-de144cb94d6a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:59:26 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:59:26 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 21:59:26 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:59:26 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 21:59:26 user nova-compute[71325]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 (non-flash)
Apr 13 21:59:26 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 21:59:26 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 21:59:26 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c4435990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4'): ({'sdf'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Removing single pathed devices sdf {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0882c65-4911-417e-a008-1f3be09b1c53]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7657c18-22a2-4bdf-9214-8ce0f7d7a55b]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flushing IO for device /dev/sdf {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[919df861-2558-40f2-afff-f05f514eb691]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bddf15-86d7-4c18-b27a-5510f58d04a6]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] SCSI volumes sdf have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c09666d-2ef9-4eb9-9f8b-5f51a5048b05]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c2af20-f2db-449c-84a0-fcdd0355efdf]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4, portal: 172.16.0.220,3260]
Apr 13 21:59:26 user nova-compute[71325]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4, portal: 172.16.0.220,3260] successful.
Apr 13 21:59:26 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3bb043-64a5-42ac-afa3-e4f0896f84d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6d160e-a2d4-4610-add9-78535c24b447]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] <== disconnect_volume: return (327ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:59:26 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:59:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-17b3c89f-adea-4d4b-a21c-785f61f42a80 req-220ef6d2-086e-4b66-8ff1-07ce399fbd20 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-changed-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:59:27 user nova-compute[71325]: DEBUG nova.compute.manager [req-17b3c89f-adea-4d4b-a21c-785f61f42a80 req-220ef6d2-086e-4b66-8ff1-07ce399fbd20 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Refreshing instance network info cache due to event network-changed-a438af72-b7ff-4ab6-82f5-59cf460c430f. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:59:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-17b3c89f-adea-4d4b-a21c-785f61f42a80 req-220ef6d2-086e-4b66-8ff1-07ce399fbd20 service nova] Acquiring lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:59:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-17b3c89f-adea-4d4b-a21c-785f61f42a80 req-220ef6d2-086e-4b66-8ff1-07ce399fbd20 service nova] Acquired lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:59:27 user nova-compute[71325]: DEBUG nova.network.neutron [req-17b3c89f-adea-4d4b-a21c-785f61f42a80 req-220ef6d2-086e-4b66-8ff1-07ce399fbd20 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Refreshing network info cache for port a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:59:27 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'flavor' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:59:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.786s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:59:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:28 user nova-compute[71325]: DEBUG nova.network.neutron [req-17b3c89f-adea-4d4b-a21c-785f61f42a80 req-220ef6d2-086e-4b66-8ff1-07ce399fbd20 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Updated VIF entry in instance network info cache for port a438af72-b7ff-4ab6-82f5-59cf460c430f. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:59:28 user nova-compute[71325]: DEBUG nova.network.neutron [req-17b3c89f-adea-4d4b-a21c-785f61f42a80 req-220ef6d2-086e-4b66-8ff1-07ce399fbd20 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Updating instance_info_cache with network_info: [{"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:59:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-17b3c89f-adea-4d4b-a21c-785f61f42a80 req-220ef6d2-086e-4b66-8ff1-07ce399fbd20 service nova] Releasing lock "refresh_cache-b87dfe1b-f651-436d-87b5-eb257ef1a6e8" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:59:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:59:28 user nova-compute[71325]: INFO nova.compute.manager [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] instance snapshotting
Apr 13 21:59:29 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Beginning live snapshot process
Apr 13 21:59:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json -f qcow2 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json -f qcow2 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf5ar63jp/ae377c85f6c74102b442de688638248a.delta 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf5ar63jp/ae377c85f6c74102b442de688638248a.delta 1073741824" returned: 0 in 0.054s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:29 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 21:59:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:59:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 21:59:31 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 21:59:31 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:59:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf5ar63jp/ae377c85f6c74102b442de688638248a.delta /opt/stack/data/nova/instances/snapshots/tmpf5ar63jp/ae377c85f6c74102b442de688638248a {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:59:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf5ar63jp/ae377c85f6c74102b442de688638248a.delta /opt/stack/data/nova/instances/snapshots/tmpf5ar63jp/ae377c85f6c74102b442de688638248a" returned: 0 in 0.603s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:59:31 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Snapshot extracted, beginning image upload
Apr 13 21:59:32 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423157.8664112, 78b584a2-7dbc-4793-9d93-37897f9a24b1 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:59:32 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] VM Stopped (Lifecycle Event)
Apr 13 21:59:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-da728c69-51bc-4274-9403-f5c3c41a065f None None] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:59:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:35 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Snapshot image upload complete
Apr 13 21:59:35 user nova-compute[71325]: INFO nova.compute.manager [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Took 6.13 seconds to snapshot the instance on the hypervisor.
Apr 13 21:59:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:59:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:02 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:00:02 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:02 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:00:02 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:00:02 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:00:02 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:03 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:00:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:03 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:00:03 user nova-compute[71325]: INFO nova.compute.claims [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Claim successful on node user
Apr 13 22:00:03 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:00:03 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:00:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:03 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:00:03 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:00:03 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:00:03 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:00:03 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:00:03 user nova-compute[71325]: INFO nova.virt.block_device [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Booting with volume snapshot 5c98e374-3252-4d7b-9511-81cd4dcdb3e1 at /dev/vda
Apr 13 22:00:03 user nova-compute[71325]: DEBUG nova.policy [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:00:04 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Successfully created port: b3d59b06-5861-436f-abe4-a543fe5e6229 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:00:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Successfully updated port: b3d59b06-5861-436f-abe4-a543fe5e6229 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:00:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "refresh_cache-1ad162f6-4270-468f-baa6-52bbb7e0adfe" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:00:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquired lock "refresh_cache-1ad162f6-4270-468f-baa6-52bbb7e0adfe" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:00:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:00:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-c1a8094d-5612-4448-aeaf-1476a3482fa6 req-9d096eb5-466a-40cf-ae7d-3730603d69e2 service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Received event network-changed-b3d59b06-5861-436f-abe4-a543fe5e6229 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-c1a8094d-5612-4448-aeaf-1476a3482fa6 req-9d096eb5-466a-40cf-ae7d-3730603d69e2 service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Refreshing instance network info cache due to event network-changed-b3d59b06-5861-436f-abe4-a543fe5e6229. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:00:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c1a8094d-5612-4448-aeaf-1476a3482fa6 req-9d096eb5-466a-40cf-ae7d-3730603d69e2 service nova] Acquiring lock "refresh_cache-1ad162f6-4270-468f-baa6-52bbb7e0adfe" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:00:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:00:06 user nova-compute[71325]: DEBUG nova.network.neutron [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Updating instance_info_cache with network_info: [{"id": "b3d59b06-5861-436f-abe4-a543fe5e6229", "address": "fa:16:3e:37:85:d3", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d59b06-58", "ovs_interfaceid": "b3d59b06-5861-436f-abe4-a543fe5e6229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:00:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Releasing lock "refresh_cache-1ad162f6-4270-468f-baa6-52bbb7e0adfe" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:00:06 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Instance network_info: |[{"id": "b3d59b06-5861-436f-abe4-a543fe5e6229", "address": "fa:16:3e:37:85:d3", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d59b06-58", "ovs_interfaceid": "b3d59b06-5861-436f-abe4-a543fe5e6229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:00:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c1a8094d-5612-4448-aeaf-1476a3482fa6 req-9d096eb5-466a-40cf-ae7d-3730603d69e2 service nova] Acquired lock "refresh_cache-1ad162f6-4270-468f-baa6-52bbb7e0adfe" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:00:06 user nova-compute[71325]: DEBUG nova.network.neutron [req-c1a8094d-5612-4448-aeaf-1476a3482fa6 req-9d096eb5-466a-40cf-ae7d-3730603d69e2 service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Refreshing network info cache for port b3d59b06-5861-436f-abe4-a543fe5e6229 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:00:06 user nova-compute[71325]: DEBUG nova.network.neutron [req-c1a8094d-5612-4448-aeaf-1476a3482fa6 req-9d096eb5-466a-40cf-ae7d-3730603d69e2 service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Updated VIF entry in instance network info cache for port b3d59b06-5861-436f-abe4-a543fe5e6229. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:00:06 user nova-compute[71325]: DEBUG nova.network.neutron [req-c1a8094d-5612-4448-aeaf-1476a3482fa6 req-9d096eb5-466a-40cf-ae7d-3730603d69e2 service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Updating instance_info_cache with network_info: [{"id": "b3d59b06-5861-436f-abe4-a543fe5e6229", "address": "fa:16:3e:37:85:d3", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d59b06-58", "ovs_interfaceid": "b3d59b06-5861-436f-abe4-a543fe5e6229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:00:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c1a8094d-5612-4448-aeaf-1476a3482fa6 req-9d096eb5-466a-40cf-ae7d-3730603d69e2 service nova] Releasing lock "refresh_cache-1ad162f6-4270-468f-baa6-52bbb7e0adfe" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:00:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG os_brick.utils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71d981b-c494-47b8-a994-3f157c4832c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7b0646-c750-4c83-83da-85efa4bdb8bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[131d4e4b-ce7e-4094-8c8d-76773f1b9bc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0184c7d3-5ffb-4c55-b962-e9126f1b0475]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:00:10 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:00:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc6060b-550e-4008-b8cf-6799e3d3f02c]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG os_brick.utils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:00:10 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Updating existing volume attachment record: 529431fb-ca51-403e-8d06-b6350e510789 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:00:12 user nova-compute[71325]: INFO nova.compute.claims [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Claim successful on node user
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Skipping network cache update for instance because it is Building. {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Skipping network cache update for instance because it is Building. {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lazy-loading 'info_cache' on Instance uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:00:12 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.policy [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:00:12 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Creating image(s)
Apr 13 22:00:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "/opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "/opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "/opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk 1073741824" returned: 0 in 0.060s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Updating instance_info_cache with network_info: [{"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Cannot resize image /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG nova.objects.instance [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'migration_context' on Instance uuid 37c5f603-6f39-4fc7-a86e-be1b6cebde5b {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Ensure instance console log exists: /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Successfully created port: b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:00:14 user nova-compute[71325]: INFO nova.compute.claims [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Claim successful on node user
Apr 13 22:00:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:00:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Successfully updated port: b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "refresh_cache-37c5f603-6f39-4fc7-a86e-be1b6cebde5b" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquired lock "refresh_cache-37c5f603-6f39-4fc7-a86e-be1b6cebde5b" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-9176430e-2bca-4db4-a5a8-bbba45c9c1d3 req-02c248ff-cf89-4776-b49f-056c182f1b1d service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Received event network-changed-b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-9176430e-2bca-4db4-a5a8-bbba45c9c1d3 req-02c248ff-cf89-4776-b49f-056c182f1b1d service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Refreshing instance network info cache due to event network-changed-b2a829d9-30f3-4537-8cd8-610561188ec1. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9176430e-2bca-4db4-a5a8-bbba45c9c1d3 req-02c248ff-cf89-4776-b49f-056c182f1b1d service nova] Acquiring lock "refresh_cache-37c5f603-6f39-4fc7-a86e-be1b6cebde5b" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:00:15 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Creating image(s)
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Ensure instance console log exists: /opt/stack/data/nova/instances/1ad162f6-4270-468f-baa6-52bbb7e0adfe/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Start _get_guest_xml network_info=[{"id": "b3d59b06-5861-436f-abe4-a543fe5e6229", "address": "fa:16:3e:37:85:d3", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d59b06-58", "ovs_interfaceid": "b3d59b06-5861-436f-abe4-a543fe5e6229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-13T22:00:00Z,direct_url=<?>,disk_format='qcow2',id=52b8a312-9e02-48e3-b201-4b8e6135b97e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1201758740',owner='ad824150d99044c6ab1c7829cbe01de5',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-13T22:00:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iglkrRNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ad162f6-4270-468f-baa6-52bbb7e0adfe', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7f3161c-72db-4f8c-beb4-863b9d4ca082', 'serial': 'f7f3161c-72db-4f8c-beb4-863b9d4ca082'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '529431fb-ca51-403e-8d06-b6350e510789', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:00:15 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-13T22:00:00Z,direct_url=<?>,disk_format='qcow2',id=52b8a312-9e02-48e3-b201-4b8e6135b97e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1201758740',owner='ad824150d99044c6ab1c7829cbe01de5',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-13T22:00:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iglkrRNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:00:15 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:00:15 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:00:15 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbb6cd2-be8a-4e48-80e3-58b1cf31998e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:00:15 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0073f047-6948-4716-ac50-b04cb695543d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082] added
Apr 13 22:00:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cae3e8d-67ec-40c9-921c-d58b832bf17b]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5606bfc7-a966-48df-96fa-a6fdd6faaddb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iglkrRNA {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iglkrRNA" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[865d1bc3-ffc8-4396-82e6-21328f620e09]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iglkrRNA'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbec7225-8c43-4a77-8954-d34550378780]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[242fcda0-4f2c-4a05-9d35-e2e89d44820e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:00:15 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:00:15 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 22:00:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:00:15 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:00:15 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 22:00:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.990s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7428a51-2172-4cbd-8628-8b3e1e8ccca8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Updating instance_info_cache with network_info: [{"id": "b2a829d9-30f3-4537-8cd8-610561188ec1", "address": "fa:16:3e:0b:fa:8b", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a829d9-30", "ovs_interfaceid": "b2a829d9-30f3-4537-8cd8-610561188ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082, portal: 172.16.0.220,3260]
Apr 13 22:00:15 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082, portal: 172.16.0.220,3260] successful.
Apr 13 22:00:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Releasing lock "refresh_cache-37c5f603-6f39-4fc7-a86e-be1b6cebde5b" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Instance network_info: |[{"id": "b2a829d9-30f3-4537-8cd8-610561188ec1", "address": "fa:16:3e:0b:fa:8b", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a829d9-30", "ovs_interfaceid": "b2a829d9-30f3-4537-8cd8-610561188ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9176430e-2bca-4db4-a5a8-bbba45c9c1d3 req-02c248ff-cf89-4776-b49f-056c182f1b1d service nova] Acquired lock "refresh_cache-37c5f603-6f39-4fc7-a86e-be1b6cebde5b" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.network.neutron [req-9176430e-2bca-4db4-a5a8-bbba45c9c1d3 req-02c248ff-cf89-4776-b49f-056c182f1b1d service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Refreshing network info cache for port b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Start _get_guest_xml network_info=[{"id": "b2a829d9-30f3-4537-8cd8-610561188ec1", "address": "fa:16:3e:0b:fa:8b", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a829d9-30", "ovs_interfaceid": "b2a829d9-30f3-4537-8cd8-610561188ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[059fd636-91d8-4413-88a9-4cf2e678c387]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:15 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3da796b-38ea-42dd-987a-920ef06e7206]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:00:15 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:00:15 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 22:00:15 user nova-compute[71325]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 (non-flash)
Apr 13 22:00:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:00:15 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:00:15 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 22:00:15 user nova-compute[71325]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 (non-flash)
Apr 13 22:00:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.477s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:00:15 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1306572424',display_name='tempest-AttachVolumeNegativeTest-server-1306572424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1306572424',id=32,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjiikkEbrTg/WryaLvM1VDBK+suc/5Dwvx4Vdfw0N4JZlXsBGsrIYAKH3AVlUtKrIJJ9MHQm23G5QpUddzkgRiVYi6Zqn9zRRQGQMAPCalG/ExBhF8Y3ZVyscy/IXA5kg==',key_name='tempest-keypair-1140702761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446b51db737947ab9bddd5fc47488bc7',ramdisk_id='',reservation_id='r-3na75uah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-920375840',owner_user_name='tempest-AttachVolumeNegativeTest-920375840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145c0a177fcc4b94b5480d8806554ac9',uuid=37c5f603-6f39-4fc7-a86e-be1b6cebde5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2a829d9-30f3-4537-8cd8-610561188ec1", "address": "fa:16:3e:0b:fa:8b", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a829d9-30", "ovs_interfaceid": "b2a829d9-30f3-4537-8cd8-610561188ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converting VIF {"id": "b2a829d9-30f3-4537-8cd8-610561188ec1", "address": "fa:16:3e:0b:fa:8b", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a829d9-30", "ovs_interfaceid": "b2a829d9-30f3-4537-8cd8-610561188ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:fa:8b,bridge_name='br-int',has_traffic_filtering=True,id=b2a829d9-30f3-4537-8cd8-610561188ec1,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a829d9-30') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.objects.instance [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'pci_devices' on Instance uuid 37c5f603-6f39-4fc7-a86e-be1b6cebde5b {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8c803b-f46a-4c73-a42d-4f79526fa608]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iglkrRNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:00:15 user nova-compute[71325]:   <uuid>37c5f603-6f39-4fc7-a86e-be1b6cebde5b</uuid>
Apr 13 22:00:15 user nova-compute[71325]:   <name>instance-00000020</name>
Apr 13 22:00:15 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:00:15 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:00:15 user nova-compute[71325]:   <metadata>
Apr 13 22:00:15 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:00:15 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:00:15 user nova-compute[71325]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1306572424</nova:name>
Apr 13 22:00:15 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:00:15</nova:creationTime>
Apr 13 22:00:15 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:00:15 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:00:15 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:00:15 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:00:15 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:00:15 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:00:15 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:00:15 user nova-compute[71325]:       <nova:owner>
Apr 13 22:00:15 user nova-compute[71325]:         <nova:user uuid="145c0a177fcc4b94b5480d8806554ac9">tempest-AttachVolumeNegativeTest-920375840-project-member</nova:user>
Apr 13 22:00:15 user nova-compute[71325]:         <nova:project uuid="446b51db737947ab9bddd5fc47488bc7">tempest-AttachVolumeNegativeTest-920375840</nova:project>
Apr 13 22:00:15 user nova-compute[71325]:       </nova:owner>
Apr 13 22:00:15 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 22:00:15 user nova-compute[71325]:       <nova:ports>
Apr 13 22:00:15 user nova-compute[71325]:         <nova:port uuid="b2a829d9-30f3-4537-8cd8-610561188ec1">
Apr 13 22:00:15 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 22:00:15 user nova-compute[71325]:         </nova:port>
Apr 13 22:00:15 user nova-compute[71325]:       </nova:ports>
Apr 13 22:00:15 user nova-compute[71325]:     </nova:instance>
Apr 13 22:00:15 user nova-compute[71325]:   </metadata>
Apr 13 22:00:15 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:00:15 user nova-compute[71325]:     <system>
Apr 13 22:00:15 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:00:15 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:00:15 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:00:15 user nova-compute[71325]:       <entry name="serial">37c5f603-6f39-4fc7-a86e-be1b6cebde5b</entry>
Apr 13 22:00:15 user nova-compute[71325]:       <entry name="uuid">37c5f603-6f39-4fc7-a86e-be1b6cebde5b</entry>
Apr 13 22:00:15 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:00:15 user nova-compute[71325]:     </system>
Apr 13 22:00:15 user nova-compute[71325]:   </sysinfo>
Apr 13 22:00:15 user nova-compute[71325]:   <os>
Apr 13 22:00:15 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:00:15 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:00:15 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:00:15 user nova-compute[71325]:   </os>
Apr 13 22:00:15 user nova-compute[71325]:   <features>
Apr 13 22:00:15 user nova-compute[71325]:     <acpi/>
Apr 13 22:00:15 user nova-compute[71325]:     <apic/>
Apr 13 22:00:15 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:00:15 user nova-compute[71325]:   </features>
Apr 13 22:00:15 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:00:15 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:00:15 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:00:15 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:00:15 user nova-compute[71325]:   </clock>
Apr 13 22:00:15 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:00:15 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:00:15 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:00:15 user nova-compute[71325]:   </cpu>
Apr 13 22:00:15 user nova-compute[71325]:   <devices>
Apr 13 22:00:15 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 22:00:15 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:00:15 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk"/>
Apr 13 22:00:15 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:00:15 user nova-compute[71325]:     </disk>
Apr 13 22:00:15 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:00:15 user nova-compute[71325]:       <mac address="fa:16:3e:0b:fa:8b"/>
Apr 13 22:00:15 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:00:15 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:00:15 user nova-compute[71325]:       <target dev="tapb2a829d9-30"/>
Apr 13 22:00:15 user nova-compute[71325]:     </interface>
Apr 13 22:00:15 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:00:15 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/console.log" append="off"/>
Apr 13 22:00:15 user nova-compute[71325]:     </serial>
Apr 13 22:00:15 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:00:15 user nova-compute[71325]:     <video>
Apr 13 22:00:15 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:00:15 user nova-compute[71325]:     </video>
Apr 13 22:00:15 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:00:15 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:00:15 user nova-compute[71325]:     </rng>
Apr 13 22:00:15 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:00:15 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:00:15 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:00:15 user nova-compute[71325]:     </memballoon>
Apr 13 22:00:15 user nova-compute[71325]:   </devices>
Apr 13 22:00:15 user nova-compute[71325]: </domain>
Apr 13 22:00:15 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1306572424',display_name='tempest-AttachVolumeNegativeTest-server-1306572424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1306572424',id=32,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjiikkEbrTg/WryaLvM1VDBK+suc/5Dwvx4Vdfw0N4JZlXsBGsrIYAKH3AVlUtKrIJJ9MHQm23G5QpUddzkgRiVYi6Zqn9zRRQGQMAPCalG/ExBhF8Y3ZVyscy/IXA5kg==',key_name='tempest-keypair-1140702761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446b51db737947ab9bddd5fc47488bc7',ramdisk_id='',reservation_id='r-3na75uah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-920375840',owner_user_name='tempest-AttachVolumeNegativeTest-920375840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145c0a177fcc4b94b5480d8806554ac9',uuid=37c5f603-6f39-4fc7-a86e-be1b6cebde5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2a829d9-30f3-4537-8cd8-610561188ec1", "address": "fa:16:3e:0b:fa:8b", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a829d9-30", "ovs_interfaceid": "b2a829d9-30f3-4537-8cd8-610561188ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converting VIF {"id": "b2a829d9-30f3-4537-8cd8-610561188ec1", "address": "fa:16:3e:0b:fa:8b", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a829d9-30", "ovs_interfaceid": "b2a829d9-30f3-4537-8cd8-610561188ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:fa:8b,bridge_name='br-int',has_traffic_filtering=True,id=b2a829d9-30f3-4537-8cd8-610561188ec1,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a829d9-30') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG os_vif [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:fa:8b,bridge_name='br-int',has_traffic_filtering=True,id=b2a829d9-30f3-4537-8cd8-610561188ec1,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a829d9-30') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2a829d9-30, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2a829d9-30, col_values=(('external_ids', {'iface-id': 'b2a829d9-30f3-4537-8cd8-610561188ec1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:fa:8b', 'vm-uuid': '37c5f603-6f39-4fc7-a86e-be1b6cebde5b'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:00:15 user nova-compute[71325]: INFO nova.compute.manager [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Terminating instance
Apr 13 22:00:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:15 user nova-compute[71325]: INFO os_vif [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:fa:8b,bridge_name='br-int',has_traffic_filtering=True,id=b2a829d9-30f3-4537-8cd8-610561188ec1,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a829d9-30')
Apr 13 22:00:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.policy [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '604839c420aa40eea9e14d5905f8ea09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b73574c6bfc4b1685eb2179f040b5a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:00:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:00:16 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Creating image(s)
Apr 13 22:00:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "/opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "/opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No VIF found with MAC fa:16:3e:0b:fa:8b, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.169s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Successfully created port: c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.073s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== connect_volume: return (2075ms) {'type': 'block', 'scsi_wwn': '26136336639653033', 'path': '/dev/sde'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136336639653033', 'path': '/dev/sde'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-22aa4047-53d7-4f8a-8b3b-37354c91f434 req-53c514aa-283d-4f9a-a363-564132c75e8e service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-vif-unplugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-22aa4047-53d7-4f8a-8b3b-37354c91f434 req-53c514aa-283d-4f9a-a363-564132c75e8e service nova] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-22aa4047-53d7-4f8a-8b3b-37354c91f434 req-53c514aa-283d-4f9a-a363-564132c75e8e service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-22aa4047-53d7-4f8a-8b3b-37354c91f434 req-53c514aa-283d-4f9a-a363-564132c75e8e service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-22aa4047-53d7-4f8a-8b3b-37354c91f434 req-53c514aa-283d-4f9a-a363-564132c75e8e service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] No waiting events found dispatching network-vif-unplugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.manager [req-22aa4047-53d7-4f8a-8b3b-37354c91f434 req-53c514aa-283d-4f9a-a363-564132c75e8e service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-vif-unplugged-a438af72-b7ff-4ab6-82f5-59cf460c430f for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 1.225s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:17 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Instance destroyed successfully.
Apr 13 22:00:17 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:00:17 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8021MB free_disk=26.114299774169922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/disk 1073741824" returned: 0 in 0.062s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.objects.instance [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'resources' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 1.299s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-83885280',display_name='tempest-ServerRescueNegativeTestJSON-server-83885280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-83885280',id=23,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEkikMBfKYBaVz9RAPAAHtgluCulNhaXlNnXRmd1wytRaQFaosDdHshmuQB0as4KbHDZo1Ux4sl5RXfhe13p5VrH2Y8uYO2igQjKNR7Nb3FHusXdWK16NLMOw2+fvY10Q==',key_name='tempest-keypair-1299306137',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:55:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70e84a09a76a44eb830e575db4321224',ramdisk_id='',reservation_id='r-3v2jgje0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-546430736',owner_user_name='tempest-ServerRescueNegativeTestJSON-546430736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e77459bc3fa8496da1a089c460e32ed2',uuid=b87dfe1b-f651-436d-87b5-eb257ef1a6e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converting VIF {"id": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "address": "fa:16:3e:79:ad:c6", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa438af72-b7", "ovs_interfaceid": "a438af72-b7ff-4ab6-82f5-59cf460c430f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:ad:c6,bridge_name='br-int',has_traffic_filtering=True,id=a438af72-b7ff-4ab6-82f5-59cf460c430f,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa438af72-b7') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG os_vif [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:ad:c6,bridge_name='br-int',has_traffic_filtering=True,id=a438af72-b7ff-4ab6-82f5-59cf460c430f,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa438af72-b7') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1526232735',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1526232735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1526232735',id=31,image_ref='52b8a312-9e02-48e3-b201-4b8e6135b97e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-a8zd1lvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1335483698',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:00:04Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=1ad162f6-4270-468f-baa6-52bbb7e0adfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3d59b06-5861-436f-abe4-a543fe5e6229", "address": "fa:16:3e:37:85:d3", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d59b06-58", "ovs_interfaceid": "b3d59b06-5861-436f-abe4-a543fe5e6229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "b3d59b06-5861-436f-abe4-a543fe5e6229", "address": "fa:16:3e:37:85:d3", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d59b06-58", "ovs_interfaceid": "b3d59b06-5861-436f-abe4-a543fe5e6229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:85:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3d59b06-5861-436f-abe4-a543fe5e6229,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d59b06-58') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.objects.instance [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ad162f6-4270-468f-baa6-52bbb7e0adfe {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa438af72-b7, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:00:17 user nova-compute[71325]:   <uuid>1ad162f6-4270-468f-baa6-52bbb7e0adfe</uuid>
Apr 13 22:00:17 user nova-compute[71325]:   <name>instance-0000001f</name>
Apr 13 22:00:17 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:00:17 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:00:17 user nova-compute[71325]:   <metadata>
Apr 13 22:00:17 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:00:17 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:00:17 user nova-compute[71325]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1526232735</nova:name>
Apr 13 22:00:17 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:00:15</nova:creationTime>
Apr 13 22:00:17 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:00:17 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:00:17 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:00:17 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:00:17 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:00:17 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:00:17 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:00:17 user nova-compute[71325]:       <nova:owner>
Apr 13 22:00:17 user nova-compute[71325]:         <nova:user uuid="50a8a5f433c94e0c9ba4d6ecea37d756">tempest-TestVolumeBootPattern-1335483698-project-member</nova:user>
Apr 13 22:00:17 user nova-compute[71325]:         <nova:project uuid="ad824150d99044c6ab1c7829cbe01de5">tempest-TestVolumeBootPattern-1335483698</nova:project>
Apr 13 22:00:17 user nova-compute[71325]:       </nova:owner>
Apr 13 22:00:17 user nova-compute[71325]:       <nova:root type="image" uuid="52b8a312-9e02-48e3-b201-4b8e6135b97e"/>
Apr 13 22:00:17 user nova-compute[71325]:       <nova:ports>
Apr 13 22:00:17 user nova-compute[71325]:         <nova:port uuid="b3d59b06-5861-436f-abe4-a543fe5e6229">
Apr 13 22:00:17 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 22:00:17 user nova-compute[71325]:         </nova:port>
Apr 13 22:00:17 user nova-compute[71325]:       </nova:ports>
Apr 13 22:00:17 user nova-compute[71325]:     </nova:instance>
Apr 13 22:00:17 user nova-compute[71325]:   </metadata>
Apr 13 22:00:17 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:00:17 user nova-compute[71325]:     <system>
Apr 13 22:00:17 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:00:17 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:00:17 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:00:17 user nova-compute[71325]:       <entry name="serial">1ad162f6-4270-468f-baa6-52bbb7e0adfe</entry>
Apr 13 22:00:17 user nova-compute[71325]:       <entry name="uuid">1ad162f6-4270-468f-baa6-52bbb7e0adfe</entry>
Apr 13 22:00:17 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:00:17 user nova-compute[71325]:     </system>
Apr 13 22:00:17 user nova-compute[71325]:   </sysinfo>
Apr 13 22:00:17 user nova-compute[71325]:   <os>
Apr 13 22:00:17 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:00:17 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:00:17 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:00:17 user nova-compute[71325]:   </os>
Apr 13 22:00:17 user nova-compute[71325]:   <features>
Apr 13 22:00:17 user nova-compute[71325]:     <acpi/>
Apr 13 22:00:17 user nova-compute[71325]:     <apic/>
Apr 13 22:00:17 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:00:17 user nova-compute[71325]:   </features>
Apr 13 22:00:17 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:00:17 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:00:17 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:00:17 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:00:17 user nova-compute[71325]:   </clock>
Apr 13 22:00:17 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:00:17 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:00:17 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:00:17 user nova-compute[71325]:   </cpu>
Apr 13 22:00:17 user nova-compute[71325]:   <devices>
Apr 13 22:00:17 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 22:00:17 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:00:17 user nova-compute[71325]:       <source dev="/dev/sde"/>
Apr 13 22:00:17 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:00:17 user nova-compute[71325]:       <serial>f7f3161c-72db-4f8c-beb4-863b9d4ca082</serial>
Apr 13 22:00:17 user nova-compute[71325]:     </disk>
Apr 13 22:00:17 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:00:17 user nova-compute[71325]:       <mac address="fa:16:3e:37:85:d3"/>
Apr 13 22:00:17 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:00:17 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:00:17 user nova-compute[71325]:       <target dev="tapb3d59b06-58"/>
Apr 13 22:00:17 user nova-compute[71325]:     </interface>
Apr 13 22:00:17 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:00:17 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/1ad162f6-4270-468f-baa6-52bbb7e0adfe/console.log" append="off"/>
Apr 13 22:00:17 user nova-compute[71325]:     </serial>
Apr 13 22:00:17 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:00:17 user nova-compute[71325]:     <video>
Apr 13 22:00:17 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:00:17 user nova-compute[71325]:     </video>
Apr 13 22:00:17 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:00:17 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:00:17 user nova-compute[71325]:     </rng>
Apr 13 22:00:17 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:00:17 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:00:17 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:00:17 user nova-compute[71325]:     </memballoon>
Apr 13 22:00:17 user nova-compute[71325]:   </devices>
Apr 13 22:00:17 user nova-compute[71325]: </domain>
Apr 13 22:00:17 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1526232735',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1526232735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1526232735',id=31,image_ref='52b8a312-9e02-48e3-b201-4b8e6135b97e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-a8zd1lvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1335483698',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:00:04Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=1ad162f6-4270-468f-baa6-52bbb7e0adfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3d59b06-5861-436f-abe4-a543fe5e6229", "address": "fa:16:3e:37:85:d3", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d59b06-58", "ovs_interfaceid": "b3d59b06-5861-436f-abe4-a543fe5e6229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "b3d59b06-5861-436f-abe4-a543fe5e6229", "address": "fa:16:3e:37:85:d3", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d59b06-58", "ovs_interfaceid": "b3d59b06-5861-436f-abe4-a543fe5e6229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:85:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3d59b06-5861-436f-abe4-a543fe5e6229,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d59b06-58') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG os_vif [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:85:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3d59b06-5861-436f-abe4-a543fe5e6229,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d59b06-58') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:00:17 user nova-compute[71325]: INFO os_vif [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:ad:c6,bridge_name='br-int',has_traffic_filtering=True,id=a438af72-b7ff-4ab6-82f5-59cf460c430f,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa438af72-b7')
Apr 13 22:00:17 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Deleting instance files /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8_del
Apr 13 22:00:17 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Deletion of /opt/stack/data/nova/instances/b87dfe1b-f651-436d-87b5-eb257ef1a6e8_del complete
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3d59b06-58, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3d59b06-58, col_values=(('external_ids', {'iface-id': 'b3d59b06-5861-436f-abe4-a543fe5e6229', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:85:d3', 'vm-uuid': '1ad162f6-4270-468f-baa6-52bbb7e0adfe'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:17 user nova-compute[71325]: INFO os_vif [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:85:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3d59b06-5861-436f-abe4-a543fe5e6229,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d59b06-58')
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.network.neutron [req-9176430e-2bca-4db4-a5a8-bbba45c9c1d3 req-02c248ff-cf89-4776-b49f-056c182f1b1d service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Updated VIF entry in instance network info cache for port b2a829d9-30f3-4537-8cd8-610561188ec1. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.network.neutron [req-9176430e-2bca-4db4-a5a8-bbba45c9c1d3 req-02c248ff-cf89-4776-b49f-056c182f1b1d service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Updating instance_info_cache with network_info: [{"id": "b2a829d9-30f3-4537-8cd8-610561188ec1", "address": "fa:16:3e:0b:fa:8b", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a829d9-30", "ovs_interfaceid": "b2a829d9-30f3-4537-8cd8-610561188ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9176430e-2bca-4db4-a5a8-bbba45c9c1d3 req-02c248ff-cf89-4776-b49f-056c182f1b1d service nova] Releasing lock "refresh_cache-37c5f603-6f39-4fc7-a86e-be1b6cebde5b" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:00:17 user nova-compute[71325]: INFO nova.compute.manager [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Took 1.72 seconds to destroy the instance on the hypervisor.
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] No VIF found with MAC fa:16:3e:37:85:d3, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance bfcfa307-25f3-43e0-837b-704b5cd7783f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 15a855b1-8253-4b57-b675-edeee6a91511 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Cannot resize image /opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lazy-loading 'migration_context' on Instance uuid 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Ensure instance console log exists: /opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-b4491ea2-e6df-40d7-9f3b-8aa542c56507 req-a5071a0f-f630-4bde-b43d-6d997c8a384c service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Received event network-vif-plugged-b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b4491ea2-e6df-40d7-9f3b-8aa542c56507 req-a5071a0f-f630-4bde-b43d-6d997c8a384c service nova] Acquiring lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b4491ea2-e6df-40d7-9f3b-8aa542c56507 req-a5071a0f-f630-4bde-b43d-6d997c8a384c service nova] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b4491ea2-e6df-40d7-9f3b-8aa542c56507 req-a5071a0f-f630-4bde-b43d-6d997c8a384c service nova] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-b4491ea2-e6df-40d7-9f3b-8aa542c56507 req-a5071a0f-f630-4bde-b43d-6d997c8a384c service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] No waiting events found dispatching network-vif-plugged-b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:00:18 user nova-compute[71325]: WARNING nova.compute.manager [req-b4491ea2-e6df-40d7-9f3b-8aa542c56507 req-a5071a0f-f630-4bde-b43d-6d997c8a384c service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Received unexpected event network-vif-plugged-b2a829d9-30f3-4537-8cd8-610561188ec1 for instance with vm_state building and task_state spawning.
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Successfully updated port: c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.777s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "refresh_cache-9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquired lock "refresh_cache-9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-17876a25-e129-4aa5-a8cb-76b7ed4e5e1d req-2a557cc5-f1a8-4316-99bb-8487e63b837a service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Received event network-changed-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-17876a25-e129-4aa5-a8cb-76b7ed4e5e1d req-2a557cc5-f1a8-4316-99bb-8487e63b837a service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Refreshing instance network info cache due to event network-changed-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-17876a25-e129-4aa5-a8cb-76b7ed4e5e1d req-2a557cc5-f1a8-4316-99bb-8487e63b837a service nova] Acquiring lock "refresh_cache-9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-2f5a18f8-3a30-4dd3-b6fb-58acd2dff874 req-b59ccc7d-99c3-4c11-bc1e-cd545dbb479a service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2f5a18f8-3a30-4dd3-b6fb-58acd2dff874 req-b59ccc7d-99c3-4c11-bc1e-cd545dbb479a service nova] Acquiring lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2f5a18f8-3a30-4dd3-b6fb-58acd2dff874 req-b59ccc7d-99c3-4c11-bc1e-cd545dbb479a service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2f5a18f8-3a30-4dd3-b6fb-58acd2dff874 req-b59ccc7d-99c3-4c11-bc1e-cd545dbb479a service nova] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-2f5a18f8-3a30-4dd3-b6fb-58acd2dff874 req-b59ccc7d-99c3-4c11-bc1e-cd545dbb479a service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] No waiting events found dispatching network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:00:18 user nova-compute[71325]: WARNING nova.compute.manager [req-2f5a18f8-3a30-4dd3-b6fb-58acd2dff874 req-b59ccc7d-99c3-4c11-bc1e-cd545dbb479a service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received unexpected event network-vif-plugged-a438af72-b7ff-4ab6-82f5-59cf460c430f for instance with vm_state active and task_state deleting.
Apr 13 22:00:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:18 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Took 0.90 seconds to deallocate network for instance.
Apr 13 22:00:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Updating instance_info_cache with network_info: [{"id": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "address": "fa:16:3e:3c:f7:84", "network": {"id": "b7d5146e-b7cf-4d9d-8960-d0756c857b5d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1db2e02aef4246949d121a993c735999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f5bfca-9b", "ovs_interfaceid": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Releasing lock "refresh_cache-9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Instance network_info: |[{"id": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "address": "fa:16:3e:3c:f7:84", "network": {"id": "b7d5146e-b7cf-4d9d-8960-d0756c857b5d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1db2e02aef4246949d121a993c735999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f5bfca-9b", "ovs_interfaceid": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-17876a25-e129-4aa5-a8cb-76b7ed4e5e1d req-2a557cc5-f1a8-4316-99bb-8487e63b837a service nova] Acquired lock "refresh_cache-9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.network.neutron [req-17876a25-e129-4aa5-a8cb-76b7ed4e5e1d req-2a557cc5-f1a8-4316-99bb-8487e63b837a service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Refreshing network info cache for port c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Start _get_guest_xml network_info=[{"id": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "address": "fa:16:3e:3c:f7:84", "network": {"id": "b7d5146e-b7cf-4d9d-8960-d0756c857b5d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1db2e02aef4246949d121a993c735999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f5bfca-9b", "ovs_interfaceid": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:00:18 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:00:18 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1385621819',display_name='tempest-VolumesNegativeTest-instance-1385621819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1385621819',id=33,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b73574c6bfc4b1685eb2179f040b5a6',ramdisk_id='',reservation_id='r-042t9tg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1805091735',owner_user_name='tempest-VolumesNegativeTest-1805091735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:00:16Z,user_data=None,user_id='604839c420aa40eea9e14d5905f8ea09',uuid=9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "address": "fa:16:3e:3c:f7:84", "network": {"id": "b7d5146e-b7cf-4d9d-8960-d0756c857b5d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1db2e02aef4246949d121a993c735999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f5bfca-9b", "ovs_interfaceid": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Converting VIF {"id": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "address": "fa:16:3e:3c:f7:84", "network": {"id": "b7d5146e-b7cf-4d9d-8960-d0756c857b5d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1db2e02aef4246949d121a993c735999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f5bfca-9b", "ovs_interfaceid": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:f7:84,bridge_name='br-int',has_traffic_filtering=True,id=c8f5bfca-9b9a-46c0-8b2f-baefb56590d9,network=Network(b7d5146e-b7cf-4d9d-8960-d0756c857b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f5bfca-9b') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:00:18 user nova-compute[71325]:   <uuid>9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2</uuid>
Apr 13 22:00:18 user nova-compute[71325]:   <name>instance-00000021</name>
Apr 13 22:00:18 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:00:18 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:00:18 user nova-compute[71325]:   <metadata>
Apr 13 22:00:18 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:00:18 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:00:18 user nova-compute[71325]:       <nova:name>tempest-VolumesNegativeTest-instance-1385621819</nova:name>
Apr 13 22:00:18 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:00:18</nova:creationTime>
Apr 13 22:00:18 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:00:18 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:00:18 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:00:18 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:00:18 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:00:18 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:00:18 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:00:18 user nova-compute[71325]:       <nova:owner>
Apr 13 22:00:18 user nova-compute[71325]:         <nova:user uuid="604839c420aa40eea9e14d5905f8ea09">tempest-VolumesNegativeTest-1805091735-project-member</nova:user>
Apr 13 22:00:18 user nova-compute[71325]:         <nova:project uuid="9b73574c6bfc4b1685eb2179f040b5a6">tempest-VolumesNegativeTest-1805091735</nova:project>
Apr 13 22:00:18 user nova-compute[71325]:       </nova:owner>
Apr 13 22:00:18 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 22:00:18 user nova-compute[71325]:       <nova:ports>
Apr 13 22:00:18 user nova-compute[71325]:         <nova:port uuid="c8f5bfca-9b9a-46c0-8b2f-baefb56590d9">
Apr 13 22:00:18 user nova-compute[71325]:           <nova:ip type="fixed" address="192.168.233.94" ipVersion="4"/>
Apr 13 22:00:18 user nova-compute[71325]:         </nova:port>
Apr 13 22:00:18 user nova-compute[71325]:       </nova:ports>
Apr 13 22:00:18 user nova-compute[71325]:     </nova:instance>
Apr 13 22:00:18 user nova-compute[71325]:   </metadata>
Apr 13 22:00:18 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:00:18 user nova-compute[71325]:     <system>
Apr 13 22:00:18 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:00:18 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:00:18 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:00:18 user nova-compute[71325]:       <entry name="serial">9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2</entry>
Apr 13 22:00:18 user nova-compute[71325]:       <entry name="uuid">9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2</entry>
Apr 13 22:00:18 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:00:18 user nova-compute[71325]:     </system>
Apr 13 22:00:18 user nova-compute[71325]:   </sysinfo>
Apr 13 22:00:18 user nova-compute[71325]:   <os>
Apr 13 22:00:18 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:00:18 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:00:18 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:00:18 user nova-compute[71325]:   </os>
Apr 13 22:00:18 user nova-compute[71325]:   <features>
Apr 13 22:00:18 user nova-compute[71325]:     <acpi/>
Apr 13 22:00:18 user nova-compute[71325]:     <apic/>
Apr 13 22:00:18 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:00:18 user nova-compute[71325]:   </features>
Apr 13 22:00:18 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:00:18 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:00:18 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:00:18 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:00:18 user nova-compute[71325]:   </clock>
Apr 13 22:00:18 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:00:18 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:00:18 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:00:18 user nova-compute[71325]:   </cpu>
Apr 13 22:00:18 user nova-compute[71325]:   <devices>
Apr 13 22:00:18 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 22:00:18 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:00:18 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/disk"/>
Apr 13 22:00:18 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:00:18 user nova-compute[71325]:     </disk>
Apr 13 22:00:18 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:00:18 user nova-compute[71325]:       <mac address="fa:16:3e:3c:f7:84"/>
Apr 13 22:00:18 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:00:18 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:00:18 user nova-compute[71325]:       <target dev="tapc8f5bfca-9b"/>
Apr 13 22:00:18 user nova-compute[71325]:     </interface>
Apr 13 22:00:18 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:00:18 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/console.log" append="off"/>
Apr 13 22:00:18 user nova-compute[71325]:     </serial>
Apr 13 22:00:18 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:00:18 user nova-compute[71325]:     <video>
Apr 13 22:00:18 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:00:18 user nova-compute[71325]:     </video>
Apr 13 22:00:18 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:00:18 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:00:18 user nova-compute[71325]:     </rng>
Apr 13 22:00:18 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:00:18 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:00:18 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:00:18 user nova-compute[71325]:     </memballoon>
Apr 13 22:00:18 user nova-compute[71325]:   </devices>
Apr 13 22:00:18 user nova-compute[71325]: </domain>
Apr 13 22:00:18 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1385621819',display_name='tempest-VolumesNegativeTest-instance-1385621819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1385621819',id=33,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b73574c6bfc4b1685eb2179f040b5a6',ramdisk_id='',reservation_id='r-042t9tg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1805091735',owner_user_name='tempest-VolumesNegativeTest-1805091735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:00:16Z,user_data=None,user_id='604839c420aa40eea9e14d5905f8ea09',uuid=9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "address": "fa:16:3e:3c:f7:84", "network": {"id": "b7d5146e-b7cf-4d9d-8960-d0756c857b5d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1db2e02aef4246949d121a993c735999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f5bfca-9b", "ovs_interfaceid": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Converting VIF {"id": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "address": "fa:16:3e:3c:f7:84", "network": {"id": "b7d5146e-b7cf-4d9d-8960-d0756c857b5d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1db2e02aef4246949d121a993c735999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f5bfca-9b", "ovs_interfaceid": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:f7:84,bridge_name='br-int',has_traffic_filtering=True,id=c8f5bfca-9b9a-46c0-8b2f-baefb56590d9,network=Network(b7d5146e-b7cf-4d9d-8960-d0756c857b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f5bfca-9b') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG os_vif [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:f7:84,bridge_name='br-int',has_traffic_filtering=True,id=c8f5bfca-9b9a-46c0-8b2f-baefb56590d9,network=Network(b7d5146e-b7cf-4d9d-8960-d0756c857b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f5bfca-9b') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8f5bfca-9b, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8f5bfca-9b, col_values=(('external_ids', {'iface-id': 'c8f5bfca-9b9a-46c0-8b2f-baefb56590d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:f7:84', 'vm-uuid': '9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:18 user nova-compute[71325]: INFO os_vif [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:f7:84,bridge_name='br-int',has_traffic_filtering=True,id=c8f5bfca-9b9a-46c0-8b2f-baefb56590d9,network=Network(b7d5146e-b7cf-4d9d-8960-d0756c857b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f5bfca-9b')
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:00:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] No VIF found with MAC fa:16:3e:3c:f7:84, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:00:19 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:00:19 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:00:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:19 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Deleted allocations for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8
Apr 13 22:00:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "b87dfe1b-f651-436d-87b5-eb257ef1a6e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.302s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:19 user nova-compute[71325]: DEBUG nova.network.neutron [req-17876a25-e129-4aa5-a8cb-76b7ed4e5e1d req-2a557cc5-f1a8-4316-99bb-8487e63b837a service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Updated VIF entry in instance network info cache for port c8f5bfca-9b9a-46c0-8b2f-baefb56590d9. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:00:19 user nova-compute[71325]: DEBUG nova.network.neutron [req-17876a25-e129-4aa5-a8cb-76b7ed4e5e1d req-2a557cc5-f1a8-4316-99bb-8487e63b837a service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Updating instance_info_cache with network_info: [{"id": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "address": "fa:16:3e:3c:f7:84", "network": {"id": "b7d5146e-b7cf-4d9d-8960-d0756c857b5d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1db2e02aef4246949d121a993c735999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f5bfca-9b", "ovs_interfaceid": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:00:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-17876a25-e129-4aa5-a8cb-76b7ed4e5e1d req-2a557cc5-f1a8-4316-99bb-8487e63b837a service nova] Releasing lock "refresh_cache-9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-1f111bff-8b40-420d-ba29-dbcc4da5e3ea req-7186736b-2ea4-42ea-9f80-3b5b8e1032f9 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Received event network-vif-plugged-b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1f111bff-8b40-420d-ba29-dbcc4da5e3ea req-7186736b-2ea4-42ea-9f80-3b5b8e1032f9 service nova] Acquiring lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1f111bff-8b40-420d-ba29-dbcc4da5e3ea req-7186736b-2ea4-42ea-9f80-3b5b8e1032f9 service nova] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1f111bff-8b40-420d-ba29-dbcc4da5e3ea req-7186736b-2ea4-42ea-9f80-3b5b8e1032f9 service nova] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-1f111bff-8b40-420d-ba29-dbcc4da5e3ea req-7186736b-2ea4-42ea-9f80-3b5b8e1032f9 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] No waiting events found dispatching network-vif-plugged-b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:00:20 user nova-compute[71325]: WARNING nova.compute.manager [req-1f111bff-8b40-420d-ba29-dbcc4da5e3ea req-7186736b-2ea4-42ea-9f80-3b5b8e1032f9 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Received unexpected event network-vif-plugged-b2a829d9-30f3-4537-8cd8-610561188ec1 for instance with vm_state building and task_state spawning.
Apr 13 22:00:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-9a4a7532-9c4f-4696-a6e3-66ee46a99817 req-d59397d5-adea-4c9e-bd4c-c781a794f011 service nova] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Received event network-vif-deleted-a438af72-b7ff-4ab6-82f5-59cf460c430f {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:21 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423222.1580653, 37c5f603-6f39-4fc7-a86e-be1b6cebde5b => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:00:22 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] VM Resumed (Lifecycle Event)
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:00:22 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Instance spawned successfully.
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Received event network-vif-plugged-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] Acquiring lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] Lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] Lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] No waiting events found dispatching network-vif-plugged-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:00:22 user nova-compute[71325]: WARNING nova.compute.manager [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Received unexpected event network-vif-plugged-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 for instance with vm_state building and task_state spawning.
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Received event network-vif-plugged-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] Acquiring lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] Lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] Lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] No waiting events found dispatching network-vif-plugged-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:00:22 user nova-compute[71325]: WARNING nova.compute.manager [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Received unexpected event network-vif-plugged-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 for instance with vm_state building and task_state spawning.
Apr 13 22:00:22 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423222.1595345, 37c5f603-6f39-4fc7-a86e-be1b6cebde5b => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:00:22 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] VM Started (Lifecycle Event)
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:00:22 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:00:22 user nova-compute[71325]: INFO nova.compute.manager [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Took 9.38 seconds to spawn the instance on the hypervisor.
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:22 user nova-compute[71325]: INFO nova.compute.manager [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Took 10.20 seconds to build instance.
Apr 13 22:00:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.295s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Received event network-vif-plugged-b3d59b06-5861-436f-abe4-a543fe5e6229 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] Acquiring lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] Lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] Lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] No waiting events found dispatching network-vif-plugged-b3d59b06-5861-436f-abe4-a543fe5e6229 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:00:22 user nova-compute[71325]: WARNING nova.compute.manager [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Received unexpected event network-vif-plugged-b3d59b06-5861-436f-abe4-a543fe5e6229 for instance with vm_state building and task_state spawning.
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Received event network-vif-plugged-b3d59b06-5861-436f-abe4-a543fe5e6229 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] Acquiring lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] Lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] Lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] No waiting events found dispatching network-vif-plugged-b3d59b06-5861-436f-abe4-a543fe5e6229 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:00:22 user nova-compute[71325]: WARNING nova.compute.manager [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Received unexpected event network-vif-plugged-b3d59b06-5861-436f-abe4-a543fe5e6229 for instance with vm_state building and task_state spawning.
Apr 13 22:00:22 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:00:22 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423223.215176, 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:00:23 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] VM Resumed (Lifecycle Event)
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:23 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Instance spawned successfully.
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:00:23 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Instance spawned successfully.
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:23 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423223.2168415, 1ad162f6-4270-468f-baa6-52bbb7e0adfe => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:00:23 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] VM Resumed (Lifecycle Event)
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:23 user nova-compute[71325]: INFO nova.compute.manager [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Took 8.20 seconds to spawn the instance on the hypervisor.
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:00:23 user nova-compute[71325]: INFO nova.compute.manager [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Took 7.39 seconds to spawn the instance on the hypervisor.
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:23 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423223.2269511, 1ad162f6-4270-468f-baa6-52bbb7e0adfe => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:00:23 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] VM Started (Lifecycle Event)
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:00:23 user nova-compute[71325]: INFO nova.compute.manager [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Took 20.34 seconds to build instance.
Apr 13 22:00:23 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423223.229947, 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:00:23 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] VM Started (Lifecycle Event)
Apr 13 22:00:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.459s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:23 user nova-compute[71325]: INFO nova.compute.manager [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Took 8.88 seconds to build instance.
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.008s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:32 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423217.119431, b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:00:32 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] VM Stopped (Lifecycle Event)
Apr 13 22:00:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6c7e2d85-ee1e-4abb-8897-cf9cab8644cd None None] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:00:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:37 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:00:37 user nova-compute[71325]: INFO nova.compute.claims [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Claim successful on node user
Apr 13 22:00:37 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:00:37 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:00:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:00:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:00:37 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:00:37 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:00:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:00:37 user nova-compute[71325]: INFO nova.virt.block_device [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Booting with volume-backed-image f414347d-1c32-419c-89fc-b23b61a6c286 at /dev/vda
Apr 13 22:00:38 user nova-compute[71325]: DEBUG nova.policy [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:00:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Successfully created port: 0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:00:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:39 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Successfully updated port: 0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:00:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "refresh_cache-e874e1c2-9dd4-4ca5-b273-abd35526d921" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:00:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquired lock "refresh_cache-e874e1c2-9dd4-4ca5-b273-abd35526d921" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:00:39 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:00:39 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:00:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-862a9024-5e1d-4892-85e7-50274e0ca737 req-0f9c9d88-0d69-472f-b61f-78f043798c11 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-changed-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-862a9024-5e1d-4892-85e7-50274e0ca737 req-0f9c9d88-0d69-472f-b61f-78f043798c11 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Refreshing instance network info cache due to event network-changed-0b935ba6-4632-4032-8efd-bdb45a707797. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:00:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-862a9024-5e1d-4892-85e7-50274e0ca737 req-0f9c9d88-0d69-472f-b61f-78f043798c11 service nova] Acquiring lock "refresh_cache-e874e1c2-9dd4-4ca5-b273-abd35526d921" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:00:39 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Updating instance_info_cache with network_info: [{"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:00:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Releasing lock "refresh_cache-e874e1c2-9dd4-4ca5-b273-abd35526d921" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:00:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Instance network_info: |[{"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:00:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-862a9024-5e1d-4892-85e7-50274e0ca737 req-0f9c9d88-0d69-472f-b61f-78f043798c11 service nova] Acquired lock "refresh_cache-e874e1c2-9dd4-4ca5-b273-abd35526d921" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:00:39 user nova-compute[71325]: DEBUG nova.network.neutron [req-862a9024-5e1d-4892-85e7-50274e0ca737 req-0f9c9d88-0d69-472f-b61f-78f043798c11 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Refreshing network info cache for port 0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:00:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:40 user nova-compute[71325]: DEBUG nova.network.neutron [req-862a9024-5e1d-4892-85e7-50274e0ca737 req-0f9c9d88-0d69-472f-b61f-78f043798c11 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Updated VIF entry in instance network info cache for port 0b935ba6-4632-4032-8efd-bdb45a707797. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:00:40 user nova-compute[71325]: DEBUG nova.network.neutron [req-862a9024-5e1d-4892-85e7-50274e0ca737 req-0f9c9d88-0d69-472f-b61f-78f043798c11 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Updating instance_info_cache with network_info: [{"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:00:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-862a9024-5e1d-4892-85e7-50274e0ca737 req-0f9c9d88-0d69-472f-b61f-78f043798c11 service nova] Releasing lock "refresh_cache-e874e1c2-9dd4-4ca5-b273-abd35526d921" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:00:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG os_brick.utils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06f3266-bdd6-4620-91d9-775fc8bada75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5d207a-1670-45d8-b0b4-156914ba63f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[201d23ae-f981-49f5-8296-7dc97a7d21c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[923ebb22-05cd-4408-9e84-98be2be8f4a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:00:43 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:00:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[002954f7-50ed-4bc8-ac03-c6e57186c597]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG os_brick.utils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Updating existing volume attachment record: 6ddcfc49-9e91-4cc4-ba9a-cd2b279a8266 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:00:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "061e133a-9d17-4ff9-839a-235b05f9dd93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:00:45 user nova-compute[71325]: INFO nova.compute.claims [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Claim successful on node user
Apr 13 22:00:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG nova.network.neutron [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:00:45 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:00:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG nova.policy [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26fb3ecc54c84118b2100ff89cbc87f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388f228079fa45cb91fa08b972132fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:00:45 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Creating image(s)
Apr 13 22:00:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "/opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "/opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "/opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.025s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:45 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk 1073741824" returned: 0 in 0.052s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Checking if we can resize image /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Cannot resize image /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG nova.objects.instance [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lazy-loading 'migration_context' on Instance uuid 061e133a-9d17-4ff9-839a-235b05f9dd93 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Ensure instance console log exists: /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:46 user nova-compute[71325]: DEBUG nova.network.neutron [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Successfully created port: f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.network.neutron [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Successfully updated port: f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquired lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.network.neutron [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-443d770b-90ef-44e8-839d-3286f6bcb8af req-507008f1-1500-4be3-a59d-fb2bac435ac3 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Received event network-changed-f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-443d770b-90ef-44e8-839d-3286f6bcb8af req-507008f1-1500-4be3-a59d-fb2bac435ac3 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Refreshing instance network info cache due to event network-changed-f00a6c25-29d8-4444-8128-ba174833d8fe. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-443d770b-90ef-44e8-839d-3286f6bcb8af req-507008f1-1500-4be3-a59d-fb2bac435ac3 service nova] Acquiring lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.network.neutron [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.network.neutron [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Updating instance_info_cache with network_info: [{"id": "f00a6c25-29d8-4444-8128-ba174833d8fe", "address": "fa:16:3e:5c:ba:0a", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00a6c25-29", "ovs_interfaceid": "f00a6c25-29d8-4444-8128-ba174833d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Releasing lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.compute.manager [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Instance network_info: |[{"id": "f00a6c25-29d8-4444-8128-ba174833d8fe", "address": "fa:16:3e:5c:ba:0a", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00a6c25-29", "ovs_interfaceid": "f00a6c25-29d8-4444-8128-ba174833d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-443d770b-90ef-44e8-839d-3286f6bcb8af req-507008f1-1500-4be3-a59d-fb2bac435ac3 service nova] Acquired lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.network.neutron [req-443d770b-90ef-44e8-839d-3286f6bcb8af req-507008f1-1500-4be3-a59d-fb2bac435ac3 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Refreshing network info cache for port f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Start _get_guest_xml network_info=[{"id": "f00a6c25-29d8-4444-8128-ba174833d8fe", "address": "fa:16:3e:5c:ba:0a", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00a6c25-29", "ovs_interfaceid": "f00a6c25-29d8-4444-8128-ba174833d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:00:47 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:00:47 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:00:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-421020363',display_name='tempest-TestStampPattern-server-421020363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-421020363',id=35,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXtPnwsWU/ZHWadHD9KufzgH+i4W8Whaj89/zf4/lU/5gVOUN68ru0UJiR7TrTwJrSHaGj3qTP3uSclSDGLdxNe17FiKyjg0p2Imd/q5wAr6DX4FJCcSqsRDbLL7AtxQA==',key_name='tempest-TestStampPattern-369348447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='388f228079fa45cb91fa08b972132fbe',ramdisk_id='',reservation_id='r-c6vrh1nj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-921591052',owner_user_name='tempest-TestStampPattern-921591052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:00:46Z,user_data=None,user_id='26fb3ecc54c84118b2100ff89cbc87f6',uuid=061e133a-9d17-4ff9-839a-235b05f9dd93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f00a6c25-29d8-4444-8128-ba174833d8fe", "address": "fa:16:3e:5c:ba:0a", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00a6c25-29", "ovs_interfaceid": "f00a6c25-29d8-4444-8128-ba174833d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Converting VIF {"id": "f00a6c25-29d8-4444-8128-ba174833d8fe", "address": "fa:16:3e:5c:ba:0a", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00a6c25-29", "ovs_interfaceid": "f00a6c25-29d8-4444-8128-ba174833d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ba:0a,bridge_name='br-int',has_traffic_filtering=True,id=f00a6c25-29d8-4444-8128-ba174833d8fe,network=Network(a5cfb4cb-723b-4476-8849-b693ce8adbe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf00a6c25-29') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.objects.instance [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lazy-loading 'pci_devices' on Instance uuid 061e133a-9d17-4ff9-839a-235b05f9dd93 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:00:48 user nova-compute[71325]:   <uuid>061e133a-9d17-4ff9-839a-235b05f9dd93</uuid>
Apr 13 22:00:48 user nova-compute[71325]:   <name>instance-00000023</name>
Apr 13 22:00:48 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:00:48 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:00:48 user nova-compute[71325]:   <metadata>
Apr 13 22:00:48 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:00:48 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:00:48 user nova-compute[71325]:       <nova:name>tempest-TestStampPattern-server-421020363</nova:name>
Apr 13 22:00:48 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:00:47</nova:creationTime>
Apr 13 22:00:48 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:00:48 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:00:48 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:00:48 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:00:48 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:00:48 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:00:48 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:00:48 user nova-compute[71325]:       <nova:owner>
Apr 13 22:00:48 user nova-compute[71325]:         <nova:user uuid="26fb3ecc54c84118b2100ff89cbc87f6">tempest-TestStampPattern-921591052-project-member</nova:user>
Apr 13 22:00:48 user nova-compute[71325]:         <nova:project uuid="388f228079fa45cb91fa08b972132fbe">tempest-TestStampPattern-921591052</nova:project>
Apr 13 22:00:48 user nova-compute[71325]:       </nova:owner>
Apr 13 22:00:48 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 22:00:48 user nova-compute[71325]:       <nova:ports>
Apr 13 22:00:48 user nova-compute[71325]:         <nova:port uuid="f00a6c25-29d8-4444-8128-ba174833d8fe">
Apr 13 22:00:48 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 22:00:48 user nova-compute[71325]:         </nova:port>
Apr 13 22:00:48 user nova-compute[71325]:       </nova:ports>
Apr 13 22:00:48 user nova-compute[71325]:     </nova:instance>
Apr 13 22:00:48 user nova-compute[71325]:   </metadata>
Apr 13 22:00:48 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:00:48 user nova-compute[71325]:     <system>
Apr 13 22:00:48 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:00:48 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:00:48 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:00:48 user nova-compute[71325]:       <entry name="serial">061e133a-9d17-4ff9-839a-235b05f9dd93</entry>
Apr 13 22:00:48 user nova-compute[71325]:       <entry name="uuid">061e133a-9d17-4ff9-839a-235b05f9dd93</entry>
Apr 13 22:00:48 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:00:48 user nova-compute[71325]:     </system>
Apr 13 22:00:48 user nova-compute[71325]:   </sysinfo>
Apr 13 22:00:48 user nova-compute[71325]:   <os>
Apr 13 22:00:48 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:00:48 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:00:48 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:00:48 user nova-compute[71325]:   </os>
Apr 13 22:00:48 user nova-compute[71325]:   <features>
Apr 13 22:00:48 user nova-compute[71325]:     <acpi/>
Apr 13 22:00:48 user nova-compute[71325]:     <apic/>
Apr 13 22:00:48 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:00:48 user nova-compute[71325]:   </features>
Apr 13 22:00:48 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:00:48 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:00:48 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:00:48 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:00:48 user nova-compute[71325]:   </clock>
Apr 13 22:00:48 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:00:48 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:00:48 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:00:48 user nova-compute[71325]:   </cpu>
Apr 13 22:00:48 user nova-compute[71325]:   <devices>
Apr 13 22:00:48 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 22:00:48 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:00:48 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk"/>
Apr 13 22:00:48 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:00:48 user nova-compute[71325]:     </disk>
Apr 13 22:00:48 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:00:48 user nova-compute[71325]:       <mac address="fa:16:3e:5c:ba:0a"/>
Apr 13 22:00:48 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:00:48 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:00:48 user nova-compute[71325]:       <target dev="tapf00a6c25-29"/>
Apr 13 22:00:48 user nova-compute[71325]:     </interface>
Apr 13 22:00:48 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:00:48 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/console.log" append="off"/>
Apr 13 22:00:48 user nova-compute[71325]:     </serial>
Apr 13 22:00:48 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:00:48 user nova-compute[71325]:     <video>
Apr 13 22:00:48 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:00:48 user nova-compute[71325]:     </video>
Apr 13 22:00:48 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:00:48 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:00:48 user nova-compute[71325]:     </rng>
Apr 13 22:00:48 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:00:48 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:00:48 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:00:48 user nova-compute[71325]:     </memballoon>
Apr 13 22:00:48 user nova-compute[71325]:   </devices>
Apr 13 22:00:48 user nova-compute[71325]: </domain>
Apr 13 22:00:48 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-421020363',display_name='tempest-TestStampPattern-server-421020363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-421020363',id=35,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXtPnwsWU/ZHWadHD9KufzgH+i4W8Whaj89/zf4/lU/5gVOUN68ru0UJiR7TrTwJrSHaGj3qTP3uSclSDGLdxNe17FiKyjg0p2Imd/q5wAr6DX4FJCcSqsRDbLL7AtxQA==',key_name='tempest-TestStampPattern-369348447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='388f228079fa45cb91fa08b972132fbe',ramdisk_id='',reservation_id='r-c6vrh1nj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-921591052',owner_user_name='tempest-TestStampPattern-921591052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:00:46Z,user_data=None,user_id='26fb3ecc54c84118b2100ff89cbc87f6',uuid=061e133a-9d17-4ff9-839a-235b05f9dd93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f00a6c25-29d8-4444-8128-ba174833d8fe", "address": "fa:16:3e:5c:ba:0a", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00a6c25-29", "ovs_interfaceid": "f00a6c25-29d8-4444-8128-ba174833d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Converting VIF {"id": "f00a6c25-29d8-4444-8128-ba174833d8fe", "address": "fa:16:3e:5c:ba:0a", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00a6c25-29", "ovs_interfaceid": "f00a6c25-29d8-4444-8128-ba174833d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ba:0a,bridge_name='br-int',has_traffic_filtering=True,id=f00a6c25-29d8-4444-8128-ba174833d8fe,network=Network(a5cfb4cb-723b-4476-8849-b693ce8adbe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf00a6c25-29') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_vif [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ba:0a,bridge_name='br-int',has_traffic_filtering=True,id=f00a6c25-29d8-4444-8128-ba174833d8fe,network=Network(a5cfb4cb-723b-4476-8849-b693ce8adbe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf00a6c25-29') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf00a6c25-29, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf00a6c25-29, col_values=(('external_ids', {'iface-id': 'f00a6c25-29d8-4444-8128-ba174833d8fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:ba:0a', 'vm-uuid': '061e133a-9d17-4ff9-839a-235b05f9dd93'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:48 user nova-compute[71325]: INFO os_vif [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ba:0a,bridge_name='br-int',has_traffic_filtering=True,id=f00a6c25-29d8-4444-8128-ba174833d8fe,network=Network(a5cfb4cb-723b-4476-8849-b693ce8adbe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf00a6c25-29')
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] No VIF found with MAC fa:16:3e:5c:ba:0a, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:00:48 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Creating image(s)
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Ensure instance console log exists: /opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Start _get_guest_xml network_info=[{"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZdBmHke', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e874e1c2-9dd4-4ca5-b273-abd35526d921', 'attached_at': '', 'detached_at': '', 'volume_id': '2cbb5dd2-ad34-4b66-9716-e9dd1c04c903', 'serial': '2cbb5dd2-ad34-4b66-9716-e9dd1c04c903'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '6ddcfc49-9e91-4cc4-ba9a-cd2b279a8266', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:00:48 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:00:48 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZdBmHke', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:00:48 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:00:48 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:00:48 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5d753f-0f02-44fe-b3c5-49e770baced8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:00:48 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0174574a-bf55-418c-8049-7889bf47cb7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903] added
Apr 13 22:00:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec866a0-9d1b-4e67-b5cf-6f8baa285ce0]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.network.neutron [req-443d770b-90ef-44e8-839d-3286f6bcb8af req-507008f1-1500-4be3-a59d-fb2bac435ac3 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Updated VIF entry in instance network info cache for port f00a6c25-29d8-4444-8128-ba174833d8fe. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG nova.network.neutron [req-443d770b-90ef-44e8-839d-3286f6bcb8af req-507008f1-1500-4be3-a59d-fb2bac435ac3 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Updating instance_info_cache with network_info: [{"id": "f00a6c25-29d8-4444-8128-ba174833d8fe", "address": "fa:16:3e:5c:ba:0a", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00a6c25-29", "ovs_interfaceid": "f00a6c25-29d8-4444-8128-ba174833d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[15af3bff-efd1-4d41-9639-8a736a9088f6]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZdBmHke {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-443d770b-90ef-44e8-839d-3286f6bcb8af req-507008f1-1500-4be3-a59d-fb2bac435ac3 service nova] Releasing lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZdBmHke" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceb8486-81e9-4cf9-9c9c-8ab37baf1544]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zZdBmHke'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b582b0-ca94-4124-8a3c-cae07881c3e3]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d965dc-e4d7-4a5b-bd78-a3c87d929348]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:00:48 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:00:48 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 22:00:48 user nova-compute[71325]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 (non-flash)
Apr 13 22:00:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:00:48 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:00:48 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 22:00:48 user nova-compute[71325]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 (non-flash)
Apr 13 22:00:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0a9df3-18ab-421d-a157-5ece288c0d0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903, portal: 172.16.0.220,3260]
Apr 13 22:00:48 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903, portal: 172.16.0.220,3260] successful.
Apr 13 22:00:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8be4e98-01ef-4093-8680-db4754e1da39]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb62cc47-7ccd-47ad-8034-af4b069dbecf]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:00:48 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:00:48 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 22:00:48 user nova-compute[71325]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 (non-flash)
Apr 13 22:00:48 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:00:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:00:48 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:00:48 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 22:00:48 user nova-compute[71325]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 (non-flash)
Apr 13 22:00:48 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:00:48 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[79591a1c-d9e8-4b04-9e21-d07616e5da7a]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:00:48 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: None {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZdBmHke', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23833396532313066', 'path': '/dev/sdf'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833396532313066', 'path': '/dev/sdf'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-596484231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-596484231',id=34,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11a30fba887e4114be856d26b47a8e55',ramdisk_id='',reservation_id='r-qe9g0iq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-33854562',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:00:38Z,user_data=None,user_id='0ab740920cac4befac62a72f7ce5a817',uuid=e874e1c2-9dd4-4ca5-b273-abd35526d921,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converting VIF {"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:58:5f,bridge_name='br-int',has_traffic_filtering=True,id=0b935ba6-4632-4032-8efd-bdb45a707797,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b935ba6-46') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG nova.objects.instance [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'pci_devices' on Instance uuid e874e1c2-9dd4-4ca5-b273-abd35526d921 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-8c8235ee-c709-4c4e-b2c3-5ce19828e9c3 req-d5de1dc1-8bf3-4dc7-9e24-4144103b78bd service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Received event network-vif-plugged-f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8c8235ee-c709-4c4e-b2c3-5ce19828e9c3 req-d5de1dc1-8bf3-4dc7-9e24-4144103b78bd service nova] Acquiring lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8c8235ee-c709-4c4e-b2c3-5ce19828e9c3 req-d5de1dc1-8bf3-4dc7-9e24-4144103b78bd service nova] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8c8235ee-c709-4c4e-b2c3-5ce19828e9c3 req-d5de1dc1-8bf3-4dc7-9e24-4144103b78bd service nova] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-8c8235ee-c709-4c4e-b2c3-5ce19828e9c3 req-d5de1dc1-8bf3-4dc7-9e24-4144103b78bd service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] No waiting events found dispatching network-vif-plugged-f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:00:49 user nova-compute[71325]: WARNING nova.compute.manager [req-8c8235ee-c709-4c4e-b2c3-5ce19828e9c3 req-d5de1dc1-8bf3-4dc7-9e24-4144103b78bd service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Received unexpected event network-vif-plugged-f00a6c25-29d8-4444-8128-ba174833d8fe for instance with vm_state building and task_state spawning.
Apr 13 22:00:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:00:49 user nova-compute[71325]:   <uuid>e874e1c2-9dd4-4ca5-b273-abd35526d921</uuid>
Apr 13 22:00:49 user nova-compute[71325]:   <name>instance-00000022</name>
Apr 13 22:00:49 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:00:49 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:00:49 user nova-compute[71325]:   <metadata>
Apr 13 22:00:49 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:00:49 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:00:49 user nova-compute[71325]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-596484231</nova:name>
Apr 13 22:00:49 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:00:48</nova:creationTime>
Apr 13 22:00:49 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:00:49 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:00:49 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:00:49 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:00:49 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:00:49 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:00:49 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:00:49 user nova-compute[71325]:       <nova:owner>
Apr 13 22:00:49 user nova-compute[71325]:         <nova:user uuid="0ab740920cac4befac62a72f7ce5a817">tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member</nova:user>
Apr 13 22:00:49 user nova-compute[71325]:         <nova:project uuid="11a30fba887e4114be856d26b47a8e55">tempest-ServerBootFromVolumeStableRescueTest-33854562</nova:project>
Apr 13 22:00:49 user nova-compute[71325]:       </nova:owner>
Apr 13 22:00:49 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 22:00:49 user nova-compute[71325]:       <nova:ports>
Apr 13 22:00:49 user nova-compute[71325]:         <nova:port uuid="0b935ba6-4632-4032-8efd-bdb45a707797">
Apr 13 22:00:49 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 22:00:49 user nova-compute[71325]:         </nova:port>
Apr 13 22:00:49 user nova-compute[71325]:       </nova:ports>
Apr 13 22:00:49 user nova-compute[71325]:     </nova:instance>
Apr 13 22:00:49 user nova-compute[71325]:   </metadata>
Apr 13 22:00:49 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:00:49 user nova-compute[71325]:     <system>
Apr 13 22:00:49 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:00:49 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:00:49 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:00:49 user nova-compute[71325]:       <entry name="serial">e874e1c2-9dd4-4ca5-b273-abd35526d921</entry>
Apr 13 22:00:49 user nova-compute[71325]:       <entry name="uuid">e874e1c2-9dd4-4ca5-b273-abd35526d921</entry>
Apr 13 22:00:49 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:00:49 user nova-compute[71325]:     </system>
Apr 13 22:00:49 user nova-compute[71325]:   </sysinfo>
Apr 13 22:00:49 user nova-compute[71325]:   <os>
Apr 13 22:00:49 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:00:49 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:00:49 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:00:49 user nova-compute[71325]:   </os>
Apr 13 22:00:49 user nova-compute[71325]:   <features>
Apr 13 22:00:49 user nova-compute[71325]:     <acpi/>
Apr 13 22:00:49 user nova-compute[71325]:     <apic/>
Apr 13 22:00:49 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:00:49 user nova-compute[71325]:   </features>
Apr 13 22:00:49 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:00:49 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:00:49 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:00:49 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:00:49 user nova-compute[71325]:   </clock>
Apr 13 22:00:49 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:00:49 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:00:49 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:00:49 user nova-compute[71325]:   </cpu>
Apr 13 22:00:49 user nova-compute[71325]:   <devices>
Apr 13 22:00:49 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 22:00:49 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:00:49 user nova-compute[71325]:       <source dev="/dev/sdf"/>
Apr 13 22:00:49 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:00:49 user nova-compute[71325]:       <serial>2cbb5dd2-ad34-4b66-9716-e9dd1c04c903</serial>
Apr 13 22:00:49 user nova-compute[71325]:     </disk>
Apr 13 22:00:49 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:00:49 user nova-compute[71325]:       <mac address="fa:16:3e:d8:58:5f"/>
Apr 13 22:00:49 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:00:49 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:00:49 user nova-compute[71325]:       <target dev="tap0b935ba6-46"/>
Apr 13 22:00:49 user nova-compute[71325]:     </interface>
Apr 13 22:00:49 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:00:49 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/console.log" append="off"/>
Apr 13 22:00:49 user nova-compute[71325]:     </serial>
Apr 13 22:00:49 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:00:49 user nova-compute[71325]:     <video>
Apr 13 22:00:49 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:00:49 user nova-compute[71325]:     </video>
Apr 13 22:00:49 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:00:49 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:00:49 user nova-compute[71325]:     </rng>
Apr 13 22:00:49 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:00:49 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:00:49 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:00:49 user nova-compute[71325]:     </memballoon>
Apr 13 22:00:49 user nova-compute[71325]:   </devices>
Apr 13 22:00:49 user nova-compute[71325]: </domain>
Apr 13 22:00:49 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-596484231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-596484231',id=34,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11a30fba887e4114be856d26b47a8e55',ramdisk_id='',reservation_id='r-qe9g0iq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-33854562',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:00:38Z,user_data=None,user_id='0ab740920cac4befac62a72f7ce5a817',uuid=e874e1c2-9dd4-4ca5-b273-abd35526d921,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converting VIF {"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:58:5f,bridge_name='br-int',has_traffic_filtering=True,id=0b935ba6-4632-4032-8efd-bdb45a707797,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b935ba6-46') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG os_vif [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:58:5f,bridge_name='br-int',has_traffic_filtering=True,id=0b935ba6-4632-4032-8efd-bdb45a707797,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b935ba6-46') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b935ba6-46, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b935ba6-46, col_values=(('external_ids', {'iface-id': '0b935ba6-4632-4032-8efd-bdb45a707797', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:58:5f', 'vm-uuid': 'e874e1c2-9dd4-4ca5-b273-abd35526d921'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:49 user nova-compute[71325]: INFO os_vif [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:58:5f,bridge_name='br-int',has_traffic_filtering=True,id=0b935ba6-4632-4032-8efd-bdb45a707797,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b935ba6-46')
Apr 13 22:00:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] No VIF found with MAC fa:16:3e:d8:58:5f, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:00:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-dd61e05c-1bdf-4f0c-8f0c-98f867e3ed3c req-59f29afb-f596-4faa-9d18-9d3987dd0a65 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dd61e05c-1bdf-4f0c-8f0c-98f867e3ed3c req-59f29afb-f596-4faa-9d18-9d3987dd0a65 service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dd61e05c-1bdf-4f0c-8f0c-98f867e3ed3c req-59f29afb-f596-4faa-9d18-9d3987dd0a65 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dd61e05c-1bdf-4f0c-8f0c-98f867e3ed3c req-59f29afb-f596-4faa-9d18-9d3987dd0a65 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-dd61e05c-1bdf-4f0c-8f0c-98f867e3ed3c req-59f29afb-f596-4faa-9d18-9d3987dd0a65 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:00:51 user nova-compute[71325]: WARNING nova.compute.manager [req-dd61e05c-1bdf-4f0c-8f0c-98f867e3ed3c req-59f29afb-f596-4faa-9d18-9d3987dd0a65 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state building and task_state spawning.
Apr 13 22:00:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-de23d385-07d0-4387-a09e-f8fa6cacf3db req-e44339a7-51fa-47e8-98ef-5cc32fe4f66a service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Received event network-vif-plugged-f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-de23d385-07d0-4387-a09e-f8fa6cacf3db req-e44339a7-51fa-47e8-98ef-5cc32fe4f66a service nova] Acquiring lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-de23d385-07d0-4387-a09e-f8fa6cacf3db req-e44339a7-51fa-47e8-98ef-5cc32fe4f66a service nova] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-de23d385-07d0-4387-a09e-f8fa6cacf3db req-e44339a7-51fa-47e8-98ef-5cc32fe4f66a service nova] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-de23d385-07d0-4387-a09e-f8fa6cacf3db req-e44339a7-51fa-47e8-98ef-5cc32fe4f66a service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] No waiting events found dispatching network-vif-plugged-f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:00:51 user nova-compute[71325]: WARNING nova.compute.manager [req-de23d385-07d0-4387-a09e-f8fa6cacf3db req-e44339a7-51fa-47e8-98ef-5cc32fe4f66a service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Received unexpected event network-vif-plugged-f00a6c25-29d8-4444-8128-ba174833d8fe for instance with vm_state building and task_state spawning.
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423251.7768602, 061e133a-9d17-4ff9-839a-235b05f9dd93 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:00:51 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] VM Resumed (Lifecycle Event)
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.compute.manager [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:00:51 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Instance spawned successfully.
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:51 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423251.779935, 061e133a-9d17-4ff9-839a-235b05f9dd93 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:00:51 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] VM Started (Lifecycle Event)
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:00:51 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:00:51 user nova-compute[71325]: INFO nova.compute.manager [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Took 6.11 seconds to spawn the instance on the hypervisor.
Apr 13 22:00:51 user nova-compute[71325]: DEBUG nova.compute.manager [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:51 user nova-compute[71325]: INFO nova.compute.manager [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Took 6.90 seconds to build instance.
Apr 13 22:00:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.004s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423253.2927358, e874e1c2-9dd4-4ca5-b273-abd35526d921 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:00:53 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] VM Resumed (Lifecycle Event)
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:00:53 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Instance spawned successfully.
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:00:53 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423253.2937784, e874e1c2-9dd4-4ca5-b273-abd35526d921 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:00:53 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] VM Started (Lifecycle Event)
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:00:53 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:00:53 user nova-compute[71325]: INFO nova.compute.manager [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Took 5.12 seconds to spawn the instance on the hypervisor.
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-57591997-2600-47e2-bd91-21e659af0f09 req-b65e8962-7d56-431a-b276-9214988ec09e service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-57591997-2600-47e2-bd91-21e659af0f09 req-b65e8962-7d56-431a-b276-9214988ec09e service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-57591997-2600-47e2-bd91-21e659af0f09 req-b65e8962-7d56-431a-b276-9214988ec09e service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-57591997-2600-47e2-bd91-21e659af0f09 req-b65e8962-7d56-431a-b276-9214988ec09e service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-57591997-2600-47e2-bd91-21e659af0f09 req-b65e8962-7d56-431a-b276-9214988ec09e service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:00:53 user nova-compute[71325]: WARNING nova.compute.manager [req-57591997-2600-47e2-bd91-21e659af0f09 req-b65e8962-7d56-431a-b276-9214988ec09e service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state building and task_state spawning.
Apr 13 22:00:53 user nova-compute[71325]: INFO nova.compute.manager [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Took 16.21 seconds to build instance.
Apr 13 22:00:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.302s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:00:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:00:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "68cb788e-be1f-44fc-b65e-b908a5831ae2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:12 user nova-compute[71325]: INFO nova.compute.manager [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Terminating instance
Apr 13 22:01:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-e035a383-7b11-4bbc-8d87-415b94c405d0 req-3114907f-7c81-4dac-a651-0f3a2474ae50 service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received event network-vif-unplugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e035a383-7b11-4bbc-8d87-415b94c405d0 req-3114907f-7c81-4dac-a651-0f3a2474ae50 service nova] Acquiring lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e035a383-7b11-4bbc-8d87-415b94c405d0 req-3114907f-7c81-4dac-a651-0f3a2474ae50 service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e035a383-7b11-4bbc-8d87-415b94c405d0 req-3114907f-7c81-4dac-a651-0f3a2474ae50 service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-e035a383-7b11-4bbc-8d87-415b94c405d0 req-3114907f-7c81-4dac-a651-0f3a2474ae50 service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] No waiting events found dispatching network-vif-unplugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG nova.compute.manager [req-e035a383-7b11-4bbc-8d87-415b94c405d0 req-3114907f-7c81-4dac-a651-0f3a2474ae50 service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received event network-vif-unplugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:13 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Instance destroyed successfully.
Apr 13 22:01:13 user nova-compute[71325]: DEBUG nova.objects.instance [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'resources' on Instance uuid 68cb788e-be1f-44fc-b65e-b908a5831ae2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:01:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-402733805',display_name='tempest-ServerRescueNegativeTestJSON-server-402733805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-402733805',id=4,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:47:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70e84a09a76a44eb830e575db4321224',ramdisk_id='',reservation_id='r-e2h2pfno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-546430736',owner_user_name='tempest-ServerRescueNegativeTestJSON-546430736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:47:09Z,user_data=None,user_id='e77459bc3fa8496da1a089c460e32ed2',uuid=68cb788e-be1f-44fc-b65e-b908a5831ae2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:01:13 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converting VIF {"id": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "address": "fa:16:3e:73:ba:92", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a7d649-3c", "ovs_interfaceid": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:01:13 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:ba:92,bridge_name='br-int',has_traffic_filtering=True,id=b4a7d649-3cf1-4452-9f1d-430f0ce841ca,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a7d649-3c') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:01:13 user nova-compute[71325]: DEBUG os_vif [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:ba:92,bridge_name='br-int',has_traffic_filtering=True,id=b4a7d649-3cf1-4452-9f1d-430f0ce841ca,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a7d649-3c') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:01:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4a7d649-3c, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:01:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:01:13 user nova-compute[71325]: INFO os_vif [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:ba:92,bridge_name='br-int',has_traffic_filtering=True,id=b4a7d649-3cf1-4452-9f1d-430f0ce841ca,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a7d649-3c')
Apr 13 22:01:13 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Deleting instance files /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2_del
Apr 13 22:01:13 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Deletion of /opt/stack/data/nova/instances/68cb788e-be1f-44fc-b65e-b908a5831ae2_del complete
Apr 13 22:01:13 user nova-compute[71325]: INFO nova.compute.manager [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 22:01:13 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:01:13 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:01:13 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:01:13 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:01:13 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:01:13 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:01:13 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Took 0.52 seconds to deallocate network for instance.
Apr 13 22:01:14 user nova-compute[71325]: DEBUG nova.compute.manager [req-061a674b-a1f5-48a1-a4e0-67659080e6b1 req-6dbe4841-52bb-4cbf-99b5-c539b5b8c544 service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received event network-vif-deleted-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:01:14 user nova-compute[71325]: INFO nova.compute.manager [req-061a674b-a1f5-48a1-a4e0-67659080e6b1 req-6dbe4841-52bb-4cbf-99b5-c539b5b8c544 service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Neutron deleted interface b4a7d649-3cf1-4452-9f1d-430f0ce841ca; detaching it from the instance and deleting it from the info cache
Apr 13 22:01:14 user nova-compute[71325]: DEBUG nova.network.neutron [req-061a674b-a1f5-48a1-a4e0-67659080e6b1 req-6dbe4841-52bb-4cbf-99b5-c539b5b8c544 service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG nova.compute.manager [req-061a674b-a1f5-48a1-a4e0-67659080e6b1 req-6dbe4841-52bb-4cbf-99b5-c539b5b8c544 service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Detach interface failed, port_id=b4a7d649-3cf1-4452-9f1d-430f0ce841ca, reason: Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:14 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Deleted allocations for instance 68cb788e-be1f-44fc-b65e-b908a5831ae2
Apr 13 22:01:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.986s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG nova.compute.manager [req-da1bd4e6-1c5d-4e89-aaec-845dc18a41bd req-0de4fb61-865f-496b-9c4e-57da348091ef service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received event network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-da1bd4e6-1c5d-4e89-aaec-845dc18a41bd req-0de4fb61-865f-496b-9c4e-57da348091ef service nova] Acquiring lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-da1bd4e6-1c5d-4e89-aaec-845dc18a41bd req-0de4fb61-865f-496b-9c4e-57da348091ef service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-da1bd4e6-1c5d-4e89-aaec-845dc18a41bd req-0de4fb61-865f-496b-9c4e-57da348091ef service nova] Lock "68cb788e-be1f-44fc-b65e-b908a5831ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:14 user nova-compute[71325]: DEBUG nova.compute.manager [req-da1bd4e6-1c5d-4e89-aaec-845dc18a41bd req-0de4fb61-865f-496b-9c4e-57da348091ef service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] No waiting events found dispatching network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:01:14 user nova-compute[71325]: WARNING nova.compute.manager [req-da1bd4e6-1c5d-4e89-aaec-845dc18a41bd req-0de4fb61-865f-496b-9c4e-57da348091ef service nova] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Received unexpected event network-vif-plugged-b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance with vm_state deleted and task_state None.
Apr 13 22:01:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Updating instance_info_cache with network_info: [{"id": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "address": "fa:16:3e:c3:11:10", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922fdd9d-6e", "ovs_interfaceid": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Cleaning up deleted instances {{(pid=71325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] There are 0 instances to clean {{(pid=71325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:01:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:01:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:18 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:01:18 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7558MB free_disk=26.106266021728516GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance bfcfa307-25f3-43e0-837b-704b5cd7783f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 15a855b1-8253-4b57-b675-edeee6a91511 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance e874e1c2-9dd4-4ca5-b273-abd35526d921 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71325) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 22:01:18 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:01:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:01:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:01:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:01:22 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:01:22 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:01:22 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:01:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:28 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423273.3660228, 68cb788e-be1f-44fc-b65e-b908a5831ae2 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:01:28 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] VM Stopped (Lifecycle Event)
Apr 13 22:01:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0a4e66d5-58b5-46a1-abd0-3a2ccd0a976d None None] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:01:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:53 user nova-compute[71325]: INFO nova.compute.manager [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Terminating instance
Apr 13 22:01:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-cac493a4-f044-44fc-81e0-3dfd436f12a0 req-6892d84c-7c98-4f80-834d-5e723cd62fce service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Received event network-vif-unplugged-b3d59b06-5861-436f-abe4-a543fe5e6229 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-cac493a4-f044-44fc-81e0-3dfd436f12a0 req-6892d84c-7c98-4f80-834d-5e723cd62fce service nova] Acquiring lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-cac493a4-f044-44fc-81e0-3dfd436f12a0 req-6892d84c-7c98-4f80-834d-5e723cd62fce service nova] Lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-cac493a4-f044-44fc-81e0-3dfd436f12a0 req-6892d84c-7c98-4f80-834d-5e723cd62fce service nova] Lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-cac493a4-f044-44fc-81e0-3dfd436f12a0 req-6892d84c-7c98-4f80-834d-5e723cd62fce service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] No waiting events found dispatching network-vif-unplugged-b3d59b06-5861-436f-abe4-a543fe5e6229 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-cac493a4-f044-44fc-81e0-3dfd436f12a0 req-6892d84c-7c98-4f80-834d-5e723cd62fce service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Received event network-vif-unplugged-b3d59b06-5861-436f-abe4-a543fe5e6229 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:54 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Instance destroyed successfully.
Apr 13 22:01:54 user nova-compute[71325]: DEBUG nova.objects.instance [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lazy-loading 'resources' on Instance uuid 1ad162f6-4270-468f-baa6-52bbb7e0adfe {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1526232735',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1526232735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1526232735',id=31,image_ref='52b8a312-9e02-48e3-b201-4b8e6135b97e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:00:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-a8zd1lvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1335483698',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:00:23Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=1ad162f6-4270-468f-baa6-52bbb7e0adfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3d59b06-5861-436f-abe4-a543fe5e6229", "address": "fa:16:3e:37:85:d3", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d59b06-58", "ovs_interfaceid": "b3d59b06-5861-436f-abe4-a543fe5e6229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "b3d59b06-5861-436f-abe4-a543fe5e6229", "address": "fa:16:3e:37:85:d3", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d59b06-58", "ovs_interfaceid": "b3d59b06-5861-436f-abe4-a543fe5e6229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:85:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3d59b06-5861-436f-abe4-a543fe5e6229,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d59b06-58') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_vif [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:85:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3d59b06-5861-436f-abe4-a543fe5e6229,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d59b06-58') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3d59b06-58, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:01:54 user nova-compute[71325]: INFO os_vif [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:85:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3d59b06-5861-436f-abe4-a543fe5e6229,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d59b06-58')
Apr 13 22:01:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iglkrRNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:01:54 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcba5b65-6806-498b-9fad-6636134d1ae0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:01:54 user nova-compute[71325]: No targets found.
Apr 13 22:01:54 user nova-compute[71325]: iSNS:
Apr 13 22:01:54 user nova-compute[71325]: No targets found.
Apr 13 22:01:54 user nova-compute[71325]: STATIC:
Apr 13 22:01:54 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082
Apr 13 22:01:54 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:01:54 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:01:54 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a
Apr 13 22:01:54 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:01:54 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:01:54 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903
Apr 13 22:01:54 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:01:54 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:01:54 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 22:01:54 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:01:54 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:01:54 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409
Apr 13 22:01:54 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:01:54 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:01:54 user nova-compute[71325]: FIRMWARE:
Apr 13 22:01:54 user nova-compute[71325]: No targets found.
Apr 13 22:01:54 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:01:54 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:01:54 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2dd87e-e249-4cc4-ac8f-e88eaf80ca66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab551537-bf69-45e5-aab0-bc111df5493a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:01:54 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:01:54 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 22:01:54 user nova-compute[71325]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 (non-flash)
Apr 13 22:01:54 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:01:54 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:01:54 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:01:54 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 22:01:54 user nova-compute[71325]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 (non-flash)
Apr 13 22:01:54 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:01:54 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc584f0ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082'): ({'sde'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Removing single pathed devices sde {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6ae3aa-dbee-44bd-b54b-538f606dd4ad]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dde1df0-9a6e-4093-b378-0f7b6ac6f579]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flushing IO for device /dev/sde {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1730d4c-754b-493d-ae40-d66937aa2c6d]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e467bd0b-8b15-4e40-8ad9-281a4c553950]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] SCSI volumes sde have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO65b2de05-a63f9e03603c359b', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_65b2de05', '/dev/disk/by-id/scsi-26136336639653033') {{(pid=82476) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 22:01:54 user nova-compute[71325]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO65b2de05-a63f9e03603c359b
Apr 13 22:01:54 user nova-compute[71325]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_65b2de05
Apr 13 22:01:54 user nova-compute[71325]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26136336639653033
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eaa0c2-c25f-44c6-aa0f-1badd5d3e0ee]: (4, None) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.047s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6f520a-6022-466f-ab13-3b83a68fed16]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e520e3-f1eb-40df-ba78-fe90481b1884]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082, portal: 172.16.0.220,3260]
Apr 13 22:01:54 user nova-compute[71325]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082, portal: 172.16.0.220,3260] successful.
Apr 13 22:01:54 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3161c-72db-4f8c-beb4-863b9d4ca082 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01b519a-085c-4908-bc90-28c8d5b563ba]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== disconnect_volume: return (385ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:01:54 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Deleting instance files /opt/stack/data/nova/instances/1ad162f6-4270-468f-baa6-52bbb7e0adfe_del
Apr 13 22:01:54 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Deletion of /opt/stack/data/nova/instances/1ad162f6-4270-468f-baa6-52bbb7e0adfe_del complete
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:54 user nova-compute[71325]: INFO nova.compute.manager [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Terminating instance
Apr 13 22:01:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:01:54 user nova-compute[71325]: INFO nova.compute.manager [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Took 1.24 seconds to destroy the instance on the hypervisor.
Apr 13 22:01:54 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:01:55 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Took 0.50 seconds to deallocate network for instance.
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-25767b0f-0155-4eb1-b34a-eebb7578ab6c req-f76a083c-b9f8-4337-ba98-291a15de67d5 service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Received event network-vif-deleted-b3d59b06-5861-436f-abe4-a543fe5e6229 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:01:55 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Instance destroyed successfully.
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'resources' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T21:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-968149372',display_name='tempest-ServerActionsTestJSON-server-1348347503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-968149372',id=14,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:59:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-p35kb61w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:59:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=c895d9cf-e6c1-42d6-88e3-1209b203fbe3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "03480082-c22f-4ad9-bc15-d536f115ec88", "address": "fa:16:3e:ef:31:9d", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03480082-c2", "ovs_interfaceid": "03480082-c22f-4ad9-bc15-d536f115ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_vif [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03480082-c2, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:01:55 user nova-compute[71325]: INFO os_vif [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:31:9d,bridge_name='br-int',has_traffic_filtering=True,id=03480082-c22f-4ad9-bc15-d536f115ec88,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03480082-c2')
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBajDAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:01:55 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a628bd15-d1f9-4122-83c2-4184c1ce6cee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:01:55 user nova-compute[71325]: No targets found.
Apr 13 22:01:55 user nova-compute[71325]: iSNS:
Apr 13 22:01:55 user nova-compute[71325]: No targets found.
Apr 13 22:01:55 user nova-compute[71325]: STATIC:
Apr 13 22:01:55 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a
Apr 13 22:01:55 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:01:55 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:01:55 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903
Apr 13 22:01:55 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:01:55 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:01:55 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 22:01:55 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:01:55 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:01:55 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409
Apr 13 22:01:55 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:01:55 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:01:55 user nova-compute[71325]: FIRMWARE:
Apr 13 22:01:55 user nova-compute[71325]: No targets found.
Apr 13 22:01:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:01:55 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:01:55 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7668d5f5-7b48-40a3-b036-f0ef29474625]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76c6700-1ce6-4ee8-b8a2-034a955e36a8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:01:55 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:01:55 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 22:01:55 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:01:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:01:55 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:01:55 user nova-compute[71325]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a (non-flash)
Apr 13 22:01:55 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:01:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5a41b6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb311356-637d-4f6e-923a-d8c39551f231]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4447bd8-f7d3-47dc-909e-7712dd9279ee]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73efcbb-10c8-404b-bbaf-0ebb1c8a355a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5806350c-7074-42d0-83ef-7786f682c15d]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eb9d4c-e9d2-4a40-b73a-1a88a95b90c7]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6c5ee2-4ea9-43d4-bd3a-9daf0f4236e0]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260]
Apr 13 22:01:55 user nova-compute[71325]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a, portal: 172.16.0.220,3260] successful.
Apr 13 22:01:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Received event network-vif-plugged-b3d59b06-5861-436f-abe4-a543fe5e6229 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Acquiring lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] No waiting events found dispatching network-vif-plugged-b3d59b06-5861-436f-abe4-a543fe5e6229 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:01:55 user nova-compute[71325]: WARNING nova.compute.manager [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Received unexpected event network-vif-plugged-b3d59b06-5861-436f-abe4-a543fe5e6229 for instance with vm_state active and task_state deleting.
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-unplugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-unplugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-unplugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Acquiring lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] No waiting events found dispatching network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:01:55 user nova-compute[71325]: WARNING nova.compute.manager [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received unexpected event network-vif-plugged-03480082-c22f-4ad9-bc15-d536f115ec88 for instance with vm_state active and task_state deleting.
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026beb94-6220-4541-8c6b-3296ae986d4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[db15d37e-f9eb-471d-beeb-057d2b94c7d2]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== disconnect_volume: return (323ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:01:55 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Deleting instance files /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3_del
Apr 13 22:01:55 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Deletion of /opt/stack/data/nova/instances/c895d9cf-e6c1-42d6-88e3-1209b203fbe3_del complete
Apr 13 22:01:55 user nova-compute[71325]: INFO nova.compute.manager [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 13 22:01:55 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:01:55 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:01:56 user nova-compute[71325]: INFO nova.compute.manager [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Took 0.80 seconds to detach 1 volumes for instance.
Apr 13 22:01:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Deleting volume: f7f3161c-72db-4f8c-beb4-863b9d4ca082 {{(pid=71325) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 22:01:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:56 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Refreshing inventories for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 22:01:56 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Updating ProviderTree inventory for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 22:01:56 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Updating inventory in ProviderTree for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 22:01:56 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Refreshing aggregate associations for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55, aggregates: None {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 22:01:56 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Refreshing trait associations for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 22:01:56 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:01:56 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Took 0.72 seconds to deallocate network for instance.
Apr 13 22:01:56 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:01:56 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:01:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.599s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:56 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Deleted allocations for instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe
Apr 13 22:01:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "1ad162f6-4270-468f-baa6-52bbb7e0adfe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.377s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:57 user nova-compute[71325]: DEBUG nova.compute.manager [req-4db03788-5918-43b6-a7e4-7b9799b24ef5 req-45ae9398-43df-4e69-922f-4f3aba1f9b9a service nova] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Received event network-vif-deleted-03480082-c22f-4ad9-bc15-d536f115ec88 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:01:57 user nova-compute[71325]: INFO nova.compute.manager [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Took 0.83 seconds to detach 1 volumes for instance.
Apr 13 22:01:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:01:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:01:57 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:01:57 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:01:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:01:57 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Deleted allocations for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3
Apr 13 22:01:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "c895d9cf-e6c1-42d6-88e3-1209b203fbe3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.312s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:03 user nova-compute[71325]: INFO nova.compute.manager [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Terminating instance
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.compute.manager [req-c9c968f0-030e-4f94-b106-23384e17710b req-a07d237a-1bdb-40d6-860e-4b82ced5cd93 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Received event network-changed-b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.compute.manager [req-c9c968f0-030e-4f94-b106-23384e17710b req-a07d237a-1bdb-40d6-860e-4b82ced5cd93 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Refreshing instance network info cache due to event network-changed-b2a829d9-30f3-4537-8cd8-610561188ec1. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c9c968f0-030e-4f94-b106-23384e17710b req-a07d237a-1bdb-40d6-860e-4b82ced5cd93 service nova] Acquiring lock "refresh_cache-37c5f603-6f39-4fc7-a86e-be1b6cebde5b" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c9c968f0-030e-4f94-b106-23384e17710b req-a07d237a-1bdb-40d6-860e-4b82ced5cd93 service nova] Acquired lock "refresh_cache-37c5f603-6f39-4fc7-a86e-be1b6cebde5b" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.network.neutron [req-c9c968f0-030e-4f94-b106-23384e17710b req-a07d237a-1bdb-40d6-860e-4b82ced5cd93 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Refreshing network info cache for port b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.compute.manager [req-acf95543-a1ab-4341-9d37-a9dfc1a354e4 req-0099e35a-4e2f-4a43-b983-b1d330218291 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-vif-unplugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acf95543-a1ab-4341-9d37-a9dfc1a354e4 req-0099e35a-4e2f-4a43-b983-b1d330218291 service nova] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acf95543-a1ab-4341-9d37-a9dfc1a354e4 req-0099e35a-4e2f-4a43-b983-b1d330218291 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-acf95543-a1ab-4341-9d37-a9dfc1a354e4 req-0099e35a-4e2f-4a43-b983-b1d330218291 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.compute.manager [req-acf95543-a1ab-4341-9d37-a9dfc1a354e4 req-0099e35a-4e2f-4a43-b983-b1d330218291 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] No waiting events found dispatching network-vif-unplugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.compute.manager [req-acf95543-a1ab-4341-9d37-a9dfc1a354e4 req-0099e35a-4e2f-4a43-b983-b1d330218291 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-vif-unplugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:02:03 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Instance destroyed successfully.
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.objects.instance [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'resources' on Instance uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-579437522',display_name='tempest-ServerRescueNegativeTestJSON-server-579437522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-579437522',id=1,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:49:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70e84a09a76a44eb830e575db4321224',ramdisk_id='',reservation_id='r-pepi5puo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-546430736',owner_user_name='tempest-ServerRescueNegativeTestJSON-546430736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:51:50Z,user_data=None,user_id='e77459bc3fa8496da1a089c460e32ed2',uuid=f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converting VIF {"id": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "address": "fa:16:3e:40:c1:d3", "network": {"id": "0a365911-1489-441d-8c9a-91c593bb18af", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1412240646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e84a09a76a44eb830e575db4321224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc6b9f2-62", "ovs_interfaceid": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:c1:d3,bridge_name='br-int',has_traffic_filtering=True,id=fdc6b9f2-62b6-44df-a2e4-e923e1e57964,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc6b9f2-62') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG os_vif [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:c1:d3,bridge_name='br-int',has_traffic_filtering=True,id=fdc6b9f2-62b6-44df-a2e4-e923e1e57964,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc6b9f2-62') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdc6b9f2-62, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:03 user nova-compute[71325]: INFO os_vif [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:c1:d3,bridge_name='br-int',has_traffic_filtering=True,id=fdc6b9f2-62b6-44df-a2e4-e923e1e57964,network=Network(0a365911-1489-441d-8c9a-91c593bb18af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc6b9f2-62')
Apr 13 22:02:03 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Deleting instance files /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de_del
Apr 13 22:02:03 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Deletion of /opt/stack/data/nova/instances/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de_del complete
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.network.neutron [req-c9c968f0-030e-4f94-b106-23384e17710b req-a07d237a-1bdb-40d6-860e-4b82ced5cd93 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Updated VIF entry in instance network info cache for port b2a829d9-30f3-4537-8cd8-610561188ec1. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.network.neutron [req-c9c968f0-030e-4f94-b106-23384e17710b req-a07d237a-1bdb-40d6-860e-4b82ced5cd93 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Updating instance_info_cache with network_info: [{"id": "b2a829d9-30f3-4537-8cd8-610561188ec1", "address": "fa:16:3e:0b:fa:8b", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a829d9-30", "ovs_interfaceid": "b2a829d9-30f3-4537-8cd8-610561188ec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c9c968f0-030e-4f94-b106-23384e17710b req-a07d237a-1bdb-40d6-860e-4b82ced5cd93 service nova] Releasing lock "refresh_cache-37c5f603-6f39-4fc7-a86e-be1b6cebde5b" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:02:03 user nova-compute[71325]: INFO nova.compute.manager [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 13 22:02:03 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:02:03 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:02:04 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:02:04 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Took 0.45 seconds to deallocate network for instance.
Apr 13 22:02:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:04 user nova-compute[71325]: INFO nova.compute.manager [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Terminating instance
Apr 13 22:02:04 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:02:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:04 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:02:04 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:02:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:04 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Deleted allocations for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de
Apr 13 22:02:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.671s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:05 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Instance destroyed successfully.
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lazy-loading 'resources' on Instance uuid 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1385621819',display_name='tempest-VolumesNegativeTest-instance-1385621819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1385621819',id=33,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:00:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b73574c6bfc4b1685eb2179f040b5a6',ramdisk_id='',reservation_id='r-042t9tg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1805091735',owner_user_name='tempest-VolumesNegativeTest-1805091735-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:00:23Z,user_data=None,user_id='604839c420aa40eea9e14d5905f8ea09',uuid=9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "address": "fa:16:3e:3c:f7:84", "network": {"id": "b7d5146e-b7cf-4d9d-8960-d0756c857b5d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1db2e02aef4246949d121a993c735999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f5bfca-9b", "ovs_interfaceid": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Converting VIF {"id": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "address": "fa:16:3e:3c:f7:84", "network": {"id": "b7d5146e-b7cf-4d9d-8960-d0756c857b5d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1db2e02aef4246949d121a993c735999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f5bfca-9b", "ovs_interfaceid": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:f7:84,bridge_name='br-int',has_traffic_filtering=True,id=c8f5bfca-9b9a-46c0-8b2f-baefb56590d9,network=Network(b7d5146e-b7cf-4d9d-8960-d0756c857b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f5bfca-9b') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG os_vif [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:f7:84,bridge_name='br-int',has_traffic_filtering=True,id=c8f5bfca-9b9a-46c0-8b2f-baefb56590d9,network=Network(b7d5146e-b7cf-4d9d-8960-d0756c857b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f5bfca-9b') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8f5bfca-9b, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:02:05 user nova-compute[71325]: INFO os_vif [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:f7:84,bridge_name='br-int',has_traffic_filtering=True,id=c8f5bfca-9b9a-46c0-8b2f-baefb56590d9,network=Network(b7d5146e-b7cf-4d9d-8960-d0756c857b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f5bfca-9b')
Apr 13 22:02:05 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Deleting instance files /opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2_del
Apr 13 22:02:05 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Deletion of /opt/stack/data/nova/instances/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2_del complete
Apr 13 22:02:05 user nova-compute[71325]: INFO nova.compute.manager [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 13 22:02:05 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-35a236b6-b86d-455e-9225-16868beaf881 req-fce9a056-125b-4a9a-8617-7eb9f082cbd8 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-vif-deleted-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:02:05 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Took 0.45 seconds to deallocate network for instance.
Apr 13 22:02:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Acquiring lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Lock "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] No waiting events found dispatching network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:02:05 user nova-compute[71325]: WARNING nova.compute.manager [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Received unexpected event network-vif-plugged-fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance with vm_state deleted and task_state None.
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Received event network-vif-unplugged-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Acquiring lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] No waiting events found dispatching network-vif-unplugged-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:02:05 user nova-compute[71325]: WARNING nova.compute.manager [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Received unexpected event network-vif-unplugged-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 for instance with vm_state deleted and task_state None.
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Received event network-vif-plugged-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Acquiring lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] No waiting events found dispatching network-vif-plugged-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:02:05 user nova-compute[71325]: WARNING nova.compute.manager [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Received unexpected event network-vif-plugged-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 for instance with vm_state deleted and task_state None.
Apr 13 22:02:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:05 user nova-compute[71325]: DEBUG nova.objects.instance [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'flavor' on Instance uuid 37c5f603-6f39-4fc7-a86e-be1b6cebde5b {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:06 user nova-compute[71325]: INFO nova.compute.manager [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Attaching volume d57a893b-7da3-4c12-874b-eceb300c851f to /dev/vdb
Apr 13 22:02:06 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.624s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG os_brick.utils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:06 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Deleted allocations for instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b13cbc-36aa-45e9-8b8f-ed582b924c68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f5b9ed-1677-485f-93af-4d9604ce50c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97d96f4-057e-4003-a2c1-564f34d60ccc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09390ac-f71d-4a48-bc37-0b416208efaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.954s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:02:06 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:02:06 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5880c1-22bd-48a2-a281-13a8affb5cae]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG os_brick.utils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:02:06 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Updating existing volume attachment record: 065be187-79cf-40c2-9f6c-b9cd4d7a7e96 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG nova.compute.manager [req-036bff9f-491e-4781-b604-facba6572b31 req-f998ceda-06d5-4dca-9d29-bdfcd2fdfeab service nova] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Received event network-vif-deleted-c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid b5ce77dc-eda4-4b96-8d61-2297d986f3ee {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid 6fbf2022-b069-440f-8513-6d107f0a7180 {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid bfcfa307-25f3-43e0-837b-704b5cd7783f {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid 15a855b1-8253-4b57-b675-edeee6a91511 {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid 37c5f603-6f39-4fc7-a86e-be1b6cebde5b {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid e874e1c2-9dd4-4ca5-b273-abd35526d921 {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid 061e133a-9d17-4ff9-839a-235b05f9dd93 {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "6fbf2022-b069-440f-8513-6d107f0a7180" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "bfcfa307-25f3-43e0-837b-704b5cd7783f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "15a855b1-8253-4b57-b675-edeee6a91511" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "15a855b1-8253-4b57-b675-edeee6a91511" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "061e133a-9d17-4ff9-839a-235b05f9dd93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "6fbf2022-b069-440f-8513-6d107f0a7180" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "15a855b1-8253-4b57-b675-edeee6a91511" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:09 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423314.224616, 1ad162f6-4270-468f-baa6-52bbb7e0adfe => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:02:09 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] VM Stopped (Lifecycle Event)
Apr 13 22:02:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-951b04a9-ca87-49e2-933c-4be6219e56ec None None] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423315.4705718, c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:02:10 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] VM Stopped (Lifecycle Event)
Apr 13 22:02:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b0b17074-cc37-487d-900d-310bcec31781 None None] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsSHkQFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:02:10 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:02:10 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:02:10 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d281607-8fc7-4663-8a87-6cb3149f00de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:02:10 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ba84ea-a319-4c59-be1d-9f77de61dbc3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f] added
Apr 13 22:02:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4cb563-80f6-4d6e-b22a-732b05405a9e]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd5c974-19da-4383-a6fe-7e19425a71c4]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jsSHkQFi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jsSHkQFi" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1749c72f-b55e-445c-9e2b-6d637fca956a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jsSHkQFi'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aa9e7d-2d46-4700-b4e5-c7b4bb02e099]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb882cd-792c-47f0-a879-4e0bbc00ea41]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:10 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:10 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:10 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:10 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db8a2fc-9497-490d-ba5e-0596722f7af6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f, portal: 172.16.0.220,3260]
Apr 13 22:02:10 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f, portal: 172.16.0.220,3260] successful.
Apr 13 22:02:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[932c6949-0c7d-498c-be72-9f329a915aca]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd8bc93-c409-49ac-ac3f-a57472fb01ea]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:10 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:10 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:10 user nova-compute[71325]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f (non-flash)
Apr 13 22:02:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:10 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:10 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:10 user nova-compute[71325]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f (non-flash)
Apr 13 22:02:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff318904-ad51-4a7a-9948-ab16e8785ca7]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:02:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsSHkQFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:02:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:02:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23166666636663534', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:02:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166666636663534', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:02:11 user nova-compute[71325]: DEBUG nova.objects.instance [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'flavor' on Instance uuid 37c5f603-6f39-4fc7-a86e-be1b6cebde5b {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:02:11 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:02:11 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:02:11 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:02:11 user nova-compute[71325]:   <serial>d57a893b-7da3-4c12-874b-eceb300c851f</serial>
Apr 13 22:02:11 user nova-compute[71325]: </disk>
Apr 13 22:02:11 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:02:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:02:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:02:12 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No VIF found with MAC fa:16:3e:0b:fa:8b, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:02:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.332s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.673s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:12 user nova-compute[71325]: INFO nova.compute.manager [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Detaching volume d57a893b-7da3-4c12-874b-eceb300c851f
Apr 13 22:02:13 user nova-compute[71325]: INFO nova.virt.block_device [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Attempting to driver detach volume d57a893b-7da3-4c12-874b-eceb300c851f from mountpoint /dev/vdb
Apr 13 22:02:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Attempting to detach device vdb from instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:02:13 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:02:13 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:02:13 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:02:13 user nova-compute[71325]:   <serial>d57a893b-7da3-4c12-874b-eceb300c851f</serial>
Apr 13 22:02:13 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:02:13 user nova-compute[71325]: </disk>
Apr 13 22:02:13 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:02:13 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Successfully detached device vdb from instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b from the persistent domain config.
Apr 13 22:02:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:02:13 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:02:13 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:02:13 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:02:13 user nova-compute[71325]:   <serial>d57a893b-7da3-4c12-874b-eceb300c851f</serial>
Apr 13 22:02:13 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:02:13 user nova-compute[71325]: </disk>
Apr 13 22:02:13 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681423333.510203, 37c5f603-6f39-4fc7-a86e-be1b6cebde5b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:02:13 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Successfully detached device vdb from instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b from the live domain config.
Apr 13 22:02:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsSHkQFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:02:13 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[31433951-c80d-4f6e-8296-eec5c8ace857]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:02:13 user nova-compute[71325]: No targets found.
Apr 13 22:02:13 user nova-compute[71325]: iSNS:
Apr 13 22:02:13 user nova-compute[71325]: No targets found.
Apr 13 22:02:13 user nova-compute[71325]: STATIC:
Apr 13 22:02:13 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f
Apr 13 22:02:13 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:02:13 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:02:13 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903
Apr 13 22:02:13 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:02:13 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:02:13 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 22:02:13 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:02:13 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:02:13 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409
Apr 13 22:02:13 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:02:13 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:02:13 user nova-compute[71325]: FIRMWARE:
Apr 13 22:02:13 user nova-compute[71325]: No targets found.
Apr 13 22:02:13 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:02:13 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:02:13 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a29b7c0-909a-43c5-9bc7-3878395030f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bd8389-9270-4a93-aac3-413ec1acae95]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:13 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:13 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:13 user nova-compute[71325]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f (non-flash)
Apr 13 22:02:13 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:13 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:13 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:13 user nova-compute[71325]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f (non-flash)
Apr 13 22:02:13 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5a41cc5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a70bbb-f409-4097-b840-0c4a59568752]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d655272-7f59-457f-a51d-f4ebbcd33fad]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea307554-e0ad-4c79-8b66-216b814fb44b]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c5e26e-57ae-4a0b-b6c7-1042c9e7fd6b]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c71bf8-2af3-4cc4-ba89-e5b2e0be26dd]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f108822f-7df8-42f9-a81f-b4d98714fbba]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f, portal: 172.16.0.220,3260]
Apr 13 22:02:13 user nova-compute[71325]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f, portal: 172.16.0.220,3260] successful.
Apr 13 22:02:13 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57a893b-7da3-4c12-874b-eceb300c851f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aca3a92-fd1c-4751-8613-13ad56849daa]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] <== disconnect_volume: return (311ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:02:13 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:02:14 user nova-compute[71325]: DEBUG nova.objects.instance [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'flavor' on Instance uuid 37c5f603-6f39-4fc7-a86e-be1b6cebde5b {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.666s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:02:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:02:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:02:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:02:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:02:16 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Updating instance_info_cache with network_info: [{"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:02:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:02:16 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:02:16 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:02:16 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:02:16 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:02:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:16 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:02:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:02:18 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:02:18 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8056MB free_disk=26.15594482421875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance bfcfa307-25f3-43e0-837b-704b5cd7783f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 15a855b1-8253-4b57-b675-edeee6a91511 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance e874e1c2-9dd4-4ca5-b273-abd35526d921 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423323.789727, f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:02:18 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] VM Stopped (Lifecycle Event)
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.compute.manager [None req-77eb77c1-7348-4170-904a-64a10969c603 None None] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:02:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:20 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423325.0124583, 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:02:20 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] VM Stopped (Lifecycle Event)
Apr 13 22:02:20 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c4fa6bf3-2f97-4afe-a921-a5cf94e156ff None None] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:02:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:02:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:21 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:02:21 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:02:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:02:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:02:24 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:02:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:27 user nova-compute[71325]: INFO nova.compute.manager [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Rescuing
Apr 13 22:02:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "refresh_cache-e874e1c2-9dd4-4ca5-b273-abd35526d921" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:02:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquired lock "refresh_cache-e874e1c2-9dd4-4ca5-b273-abd35526d921" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:02:27 user nova-compute[71325]: DEBUG nova.network.neutron [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:02:28 user nova-compute[71325]: DEBUG nova.network.neutron [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Updating instance_info_cache with network_info: [{"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:02:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Releasing lock "refresh_cache-e874e1c2-9dd4-4ca5-b273-abd35526d921" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:02:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:28 user nova-compute[71325]: DEBUG nova.compute.manager [req-12432839-1bbc-444b-acf5-e35e101a7d5e req-672071d6-aabe-4570-9a41-fb7b56791587 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-unplugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-12432839-1bbc-444b-acf5-e35e101a7d5e req-672071d6-aabe-4570-9a41-fb7b56791587 service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-12432839-1bbc-444b-acf5-e35e101a7d5e req-672071d6-aabe-4570-9a41-fb7b56791587 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-12432839-1bbc-444b-acf5-e35e101a7d5e req-672071d6-aabe-4570-9a41-fb7b56791587 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:28 user nova-compute[71325]: DEBUG nova.compute.manager [req-12432839-1bbc-444b-acf5-e35e101a7d5e req-672071d6-aabe-4570-9a41-fb7b56791587 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-unplugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:02:28 user nova-compute[71325]: WARNING nova.compute.manager [req-12432839-1bbc-444b-acf5-e35e101a7d5e req-672071d6-aabe-4570-9a41-fb7b56791587 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-unplugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state active and task_state rescuing.
Apr 13 22:02:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:28 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Instance destroyed successfully.
Apr 13 22:02:28 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Attempting a stable device rescue
Apr 13 22:02:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71325) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 22:02:29 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Instance directory exists: not creating {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 22:02:29 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Creating image(s)
Apr 13 22:02:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "/opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "/opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "/opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:29 user nova-compute[71325]: DEBUG nova.objects.instance [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'trusted_certs' on Instance uuid e874e1c2-9dd4-4ca5-b273-abd35526d921 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "526d9c2885237b3dfc30470a92409f5b7f85e368" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "526d9c2885237b3dfc30470a92409f5b7f85e368" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368.part --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368.part --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:30 user nova-compute[71325]: DEBUG nova.virt.images [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 340fc440-34ba-4f8f-a632-7f55fd754e85 was qcow2, converting to raw {{(pid=71325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 22:02:30 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 22:02:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368.part /opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368.converted {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:30 user nova-compute[71325]: DEBUG nova.compute.manager [req-4b8bd25e-656b-4ef1-970c-9dd1b0f5a419 req-2d50d1dd-a7cb-4057-b853-fa735e9df3eb service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4b8bd25e-656b-4ef1-970c-9dd1b0f5a419 req-2d50d1dd-a7cb-4057-b853-fa735e9df3eb service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4b8bd25e-656b-4ef1-970c-9dd1b0f5a419 req-2d50d1dd-a7cb-4057-b853-fa735e9df3eb service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4b8bd25e-656b-4ef1-970c-9dd1b0f5a419 req-2d50d1dd-a7cb-4057-b853-fa735e9df3eb service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:30 user nova-compute[71325]: DEBUG nova.compute.manager [req-4b8bd25e-656b-4ef1-970c-9dd1b0f5a419 req-2d50d1dd-a7cb-4057-b853-fa735e9df3eb service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:02:30 user nova-compute[71325]: WARNING nova.compute.manager [req-4b8bd25e-656b-4ef1-970c-9dd1b0f5a419 req-2d50d1dd-a7cb-4057-b853-fa735e9df3eb service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state active and task_state rescuing.
Apr 13 22:02:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368.part /opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368.converted" returned: 0 in 0.512s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368.converted --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368.converted --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "526d9c2885237b3dfc30470a92409f5b7f85e368" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.988s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "526d9c2885237b3dfc30470a92409f5b7f85e368" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "526d9c2885237b3dfc30470a92409f5b7f85e368" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368 --force-share --output=json" returned: 0 in 0.168s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368,backing_fmt=raw /opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/disk.rescue {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368,backing_fmt=raw /opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/disk.rescue" returned: 0 in 0.072s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "526d9c2885237b3dfc30470a92409f5b7f85e368" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.objects.instance [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'migration_context' on Instance uuid e874e1c2-9dd4-4ca5-b273-abd35526d921 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Start _get_guest_xml network_info=[{"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "vif_mac": "fa:16:3e:d8:58:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '340fc440-34ba-4f8f-a632-7f55fd754e85', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZdBmHke', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'e874e1c2-9dd4-4ca5-b273-abd35526d921', 'attached_at': '', 'detached_at': '', 'volume_id': '2cbb5dd2-ad34-4b66-9716-e9dd1c04c903', 'serial': '2cbb5dd2-ad34-4b66-9716-e9dd1c04c903'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '6ddcfc49-9e91-4cc4-ba9a-cd2b279a8266', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.objects.instance [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'resources' on Instance uuid e874e1c2-9dd4-4ca5-b273-abd35526d921 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.objects.instance [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'numa_topology' on Instance uuid e874e1c2-9dd4-4ca5-b273-abd35526d921 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:31 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:02:31 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.objects.instance [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'vcpu_model' on Instance uuid e874e1c2-9dd4-4ca5-b273-abd35526d921 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZdBmHke', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:02:31 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:02:31 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:02:31 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8073dc66-4478-49a8-bd3c-4be6ba17cd62]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = zZdBmHke\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 22:02:31 user nova-compute[71325]: node.name = iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903
Apr 13 22:02:31 user nova-compute[71325]: node.tpgt = -1
Apr 13 22:02:31 user nova-compute[71325]: node.startup = automatic
Apr 13 22:02:31 user nova-compute[71325]: node.leading_login = No
Apr 13 22:02:31 user nova-compute[71325]: iface.iscsi_ifacename = default
Apr 13 22:02:31 user nova-compute[71325]: iface.net_ifacename = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.ipaddress = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.prefix_len = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.hwaddress = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.transport_name = tcp
Apr 13 22:02:31 user nova-compute[71325]: iface.initiatorname = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.state = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.vlan_id = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.vlan_priority = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.vlan_state = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.iface_num = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.mtu = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.port = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.bootproto = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.subnet_mask = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.gateway = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.dhcp_alt_client_id = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.dhcp_dns = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.dhcp_learn_iqn = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.dhcp_vendor_id_state = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.dhcp_vendor_id = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.dhcp_slp_da = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.fragmentation = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.gratuitous_arp = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.incoming_forwarding = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.tos_state = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.tos = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.ttl = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.delayed_ack = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.tcp_nagle = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.tcp_wsf_state = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.tcp_wsf = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.tcp_timer_scale = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.tcp_timestamp = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.redirect = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.def_task_mgmt_timeout = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.header_digest = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.data_digest = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.immediate_data = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.initial_r2t = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.data_seq_inorder = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.data_pdu_inorder = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.erl = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.max_receive_data_len = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.first_burst_len = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.max_outstanding_r2t = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.max_burst_len = 0
Apr 13 22:02:31 user nova-compute[71325]: iface.chap_auth = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.bidi_chap = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.strict_login_compliance = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.discovery_auth = <empty>
Apr 13 22:02:31 user nova-compute[71325]: iface.discovery_logout = <empty>
Apr 13 22:02:31 user nova-compute[71325]: node.discovery_address = <empty>
Apr 13 22:02:31 user nova-compute[71325]: node.discovery_port = 0
Apr 13 22:02:31 user nova-compute[71325]: node.discovery_type = static
Apr 13 22:02:31 user nova-compute[71325]: node.session.initial_cmdsn = 0
Apr 13 22:02:31 user nova-compute[71325]: node.session.initial_login_retry_max = 8
Apr 13 22:02:31 user nova-compute[71325]: node.session.xmit_thread_priority = -20
Apr 13 22:02:31 user nova-compute[71325]: node.session.cmds_max = 128
Apr 13 22:02:31 user nova-compute[71325]: node.session.queue_depth = 32
Apr 13 22:02:31 user nova-compute[71325]: node.session.nr_sessions = 1
Apr 13 22:02:31 user nova-compute[71325]: node.session.auth.authmethod = CHAP
Apr 13 22:02:31 user nova-compute[71325]: node.session.auth.username = zZdBmHke
Apr 13 22:02:31 user nova-compute[71325]: node.session.auth.password = ***
Apr 13 22:02:31 user nova-compute[71325]: node.session.auth.username_in = <empty>
Apr 13 22:02:31 user nova-compute[71325]: node.session.auth.password_in = <empty>
Apr 13 22:02:31 user nova-compute[71325]: node.session.auth.chap_algs = MD5
Apr 13 22:02:31 user nova-compute[71325]: node.session.timeo.replacement_timeout = 120
Apr 13 22:02:31 user nova-compute[71325]: node.session.err_timeo.abort_timeout = 15
Apr 13 22:02:31 user nova-compute[71325]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 22:02:31 user nova-compute[71325]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 22:02:31 user nova-compute[71325]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 22:02:31 user nova-compute[71325]: node.session.iscsi.FastAbort = Yes
Apr 13 22:02:31 user nova-compute[71325]: node.session.iscsi.InitialR2T = No
Apr 13 22:02:31 user nova-compute[71325]: node.session.iscsi.ImmediateData = Yes
Apr 13 22:02:31 user nova-compute[71325]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 22:02:31 user nova-compute[71325]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 22:02:31 user nova-compute[71325]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 22:02:31 user nova-compute[71325]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 22:02:31 user nova-compute[71325]: node.session.iscsi.MaxConnections = 1
Apr 13 22:02:31 user nova-compute[71325]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 22:02:31 user nova-compute[71325]: node.session.iscsi.ERL = 0
Apr 13 22:02:31 user nova-compute[71325]: node.session.scan = manual
Apr 13 22:02:31 user nova-compute[71325]: node.session.reopen_max = 0
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].address = 172.16.0.220
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].port = 3260
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].startup = manual
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].tcp.window_size = 524288
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].tcp.type_of_service = 0
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].timeo.logout_timeout = 15
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].timeo.login_timeout = 15
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].timeo.auth_timeout = 45
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].iscsi.DataDigest = None
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].iscsi.IFMarker = No
Apr 13 22:02:31 user nova-compute[71325]: node.conn[0].iscsi.OFMarker = No
Apr 13 22:02:31 user nova-compute[71325]: # END RECORD
Apr 13 22:02:31 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7809fed-2616-4141-920f-750b56410515]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f6698f-0b92-4aa4-8cb8-2217c0ea1ce5]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZdBmHke {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZdBmHke" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea9841a-5fda-4c80-86c7-7419cf8fd2a8]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zZdBmHke'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2145c9-a410-45b1-8b35-8e6184b556c8]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd63a3e-a5ee-4381-97b5-aa107c2ce28d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:31 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:31 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:31 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:31 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:31 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:31 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] HCTL ('37', '0', '0', 0) found on session 37 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4ff5e6-18e4-4db1-b06c-8c13a3c8842c]: (4, ('0 0 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Searching for a device in session 37 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZdBmHke', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.208s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] <== connect_volume: return (209ms) {'type': 'block', 'scsi_wwn': '23833396532313066', 'path': '/dev/sdf'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833396532313066', 'path': '/dev/sdf'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-596484231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-596484231',id=34,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:00:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11a30fba887e4114be856d26b47a8e55',ramdisk_id='',reservation_id='r-qe9g0iq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-33854562',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:00:53Z,user_data=None,user_id='0ab740920cac4befac62a72f7ce5a817',uuid=e874e1c2-9dd4-4ca5-b273-abd35526d921,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "vif_mac": "fa:16:3e:d8:58:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converting VIF {"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "vif_mac": "fa:16:3e:d8:58:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:58:5f,bridge_name='br-int',has_traffic_filtering=True,id=0b935ba6-4632-4032-8efd-bdb45a707797,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b935ba6-46') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.objects.instance [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'pci_devices' on Instance uuid e874e1c2-9dd4-4ca5-b273-abd35526d921 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:02:31 user nova-compute[71325]:   <uuid>e874e1c2-9dd4-4ca5-b273-abd35526d921</uuid>
Apr 13 22:02:31 user nova-compute[71325]:   <name>instance-00000022</name>
Apr 13 22:02:31 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:02:31 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:02:31 user nova-compute[71325]:   <metadata>
Apr 13 22:02:31 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:02:31 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:02:31 user nova-compute[71325]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-596484231</nova:name>
Apr 13 22:02:31 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:02:31</nova:creationTime>
Apr 13 22:02:31 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:02:31 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:02:31 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:02:31 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:02:31 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:02:31 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:02:31 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:02:31 user nova-compute[71325]:       <nova:owner>
Apr 13 22:02:31 user nova-compute[71325]:         <nova:user uuid="0ab740920cac4befac62a72f7ce5a817">tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member</nova:user>
Apr 13 22:02:31 user nova-compute[71325]:         <nova:project uuid="11a30fba887e4114be856d26b47a8e55">tempest-ServerBootFromVolumeStableRescueTest-33854562</nova:project>
Apr 13 22:02:31 user nova-compute[71325]:       </nova:owner>
Apr 13 22:02:31 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 22:02:31 user nova-compute[71325]:       <nova:ports>
Apr 13 22:02:31 user nova-compute[71325]:         <nova:port uuid="0b935ba6-4632-4032-8efd-bdb45a707797">
Apr 13 22:02:31 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 22:02:31 user nova-compute[71325]:         </nova:port>
Apr 13 22:02:31 user nova-compute[71325]:       </nova:ports>
Apr 13 22:02:31 user nova-compute[71325]:     </nova:instance>
Apr 13 22:02:31 user nova-compute[71325]:   </metadata>
Apr 13 22:02:31 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:02:31 user nova-compute[71325]:     <system>
Apr 13 22:02:31 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:02:31 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:02:31 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:02:31 user nova-compute[71325]:       <entry name="serial">e874e1c2-9dd4-4ca5-b273-abd35526d921</entry>
Apr 13 22:02:31 user nova-compute[71325]:       <entry name="uuid">e874e1c2-9dd4-4ca5-b273-abd35526d921</entry>
Apr 13 22:02:31 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:02:31 user nova-compute[71325]:     </system>
Apr 13 22:02:31 user nova-compute[71325]:   </sysinfo>
Apr 13 22:02:31 user nova-compute[71325]:   <os>
Apr 13 22:02:31 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:02:31 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:02:31 user nova-compute[71325]:   </os>
Apr 13 22:02:31 user nova-compute[71325]:   <features>
Apr 13 22:02:31 user nova-compute[71325]:     <acpi/>
Apr 13 22:02:31 user nova-compute[71325]:     <apic/>
Apr 13 22:02:31 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:02:31 user nova-compute[71325]:   </features>
Apr 13 22:02:31 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:02:31 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:02:31 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:02:31 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:02:31 user nova-compute[71325]:   </clock>
Apr 13 22:02:31 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:02:31 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:02:31 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:02:31 user nova-compute[71325]:   </cpu>
Apr 13 22:02:31 user nova-compute[71325]:   <devices>
Apr 13 22:02:31 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 22:02:31 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:02:31 user nova-compute[71325]:       <source dev="/dev/sdf"/>
Apr 13 22:02:31 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:02:31 user nova-compute[71325]:       <serial>2cbb5dd2-ad34-4b66-9716-e9dd1c04c903</serial>
Apr 13 22:02:31 user nova-compute[71325]:     </disk>
Apr 13 22:02:31 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 22:02:31 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:02:31 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/disk.rescue"/>
Apr 13 22:02:31 user nova-compute[71325]:       <target dev="vdb" bus="virtio"/>
Apr 13 22:02:31 user nova-compute[71325]:       <boot order="1"/>
Apr 13 22:02:31 user nova-compute[71325]:     </disk>
Apr 13 22:02:31 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:02:31 user nova-compute[71325]:       <mac address="fa:16:3e:d8:58:5f"/>
Apr 13 22:02:31 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:02:31 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:02:31 user nova-compute[71325]:       <target dev="tap0b935ba6-46"/>
Apr 13 22:02:31 user nova-compute[71325]:     </interface>
Apr 13 22:02:31 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:02:31 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/console.log" append="off"/>
Apr 13 22:02:31 user nova-compute[71325]:     </serial>
Apr 13 22:02:31 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:02:31 user nova-compute[71325]:     <video>
Apr 13 22:02:31 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:02:31 user nova-compute[71325]:     </video>
Apr 13 22:02:31 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:02:31 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:02:31 user nova-compute[71325]:     </rng>
Apr 13 22:02:31 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:02:31 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:02:31 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:02:31 user nova-compute[71325]:     </memballoon>
Apr 13 22:02:31 user nova-compute[71325]:   </devices>
Apr 13 22:02:31 user nova-compute[71325]: </domain>
Apr 13 22:02:31 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:02:31 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Instance destroyed successfully.
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:02:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] No VIF found with MAC fa:16:3e:d8:58:5f, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:02:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:33 user nova-compute[71325]: DEBUG nova.compute.manager [req-d12b4b09-a196-449c-bf83-b341ed88daf6 req-538bf9fe-74c2-47e0-9c5d-b0792dd58029 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d12b4b09-a196-449c-bf83-b341ed88daf6 req-538bf9fe-74c2-47e0-9c5d-b0792dd58029 service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d12b4b09-a196-449c-bf83-b341ed88daf6 req-538bf9fe-74c2-47e0-9c5d-b0792dd58029 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d12b4b09-a196-449c-bf83-b341ed88daf6 req-538bf9fe-74c2-47e0-9c5d-b0792dd58029 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:33 user nova-compute[71325]: DEBUG nova.compute.manager [req-d12b4b09-a196-449c-bf83-b341ed88daf6 req-538bf9fe-74c2-47e0-9c5d-b0792dd58029 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:02:33 user nova-compute[71325]: WARNING nova.compute.manager [req-d12b4b09-a196-449c-bf83-b341ed88daf6 req-538bf9fe-74c2-47e0-9c5d-b0792dd58029 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state active and task_state rescuing.
Apr 13 22:02:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:35 user nova-compute[71325]: DEBUG nova.compute.manager [req-a688e63d-7d7d-4a02-ba8a-3a1baf2f721b req-dc751548-f8a9-4140-974d-935f596d200d service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a688e63d-7d7d-4a02-ba8a-3a1baf2f721b req-dc751548-f8a9-4140-974d-935f596d200d service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a688e63d-7d7d-4a02-ba8a-3a1baf2f721b req-dc751548-f8a9-4140-974d-935f596d200d service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-a688e63d-7d7d-4a02-ba8a-3a1baf2f721b req-dc751548-f8a9-4140-974d-935f596d200d service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:35 user nova-compute[71325]: DEBUG nova.compute.manager [req-a688e63d-7d7d-4a02-ba8a-3a1baf2f721b req-dc751548-f8a9-4140-974d-935f596d200d service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:02:35 user nova-compute[71325]: WARNING nova.compute.manager [req-a688e63d-7d7d-4a02-ba8a-3a1baf2f721b req-dc751548-f8a9-4140-974d-935f596d200d service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state active and task_state rescuing.
Apr 13 22:02:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for e874e1c2-9dd4-4ca5-b273-abd35526d921 due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 22:02:35 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423355.6798704, e874e1c2-9dd4-4ca5-b273-abd35526d921 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:02:35 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] VM Resumed (Lifecycle Event)
Apr 13 22:02:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:02:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:02:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:02:35 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 22:02:35 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423355.686707, e874e1c2-9dd4-4ca5-b273-abd35526d921 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:02:35 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] VM Started (Lifecycle Event)
Apr 13 22:02:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:02:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:02:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-167b3898-6bba-4075-830e-2e9a5079e939 req-996d328d-6854-498e-9438-25588b91db6c service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Received event network-changed-f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-167b3898-6bba-4075-830e-2e9a5079e939 req-996d328d-6854-498e-9438-25588b91db6c service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Refreshing instance network info cache due to event network-changed-f00a6c25-29d8-4444-8128-ba174833d8fe. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:02:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-167b3898-6bba-4075-830e-2e9a5079e939 req-996d328d-6854-498e-9438-25588b91db6c service nova] Acquiring lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:02:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-167b3898-6bba-4075-830e-2e9a5079e939 req-996d328d-6854-498e-9438-25588b91db6c service nova] Acquired lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:02:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-167b3898-6bba-4075-830e-2e9a5079e939 req-996d328d-6854-498e-9438-25588b91db6c service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Refreshing network info cache for port f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:02:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "061e133a-9d17-4ff9-839a-235b05f9dd93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:36 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lazy-loading 'flavor' on Instance uuid 061e133a-9d17-4ff9-839a-235b05f9dd93 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "061e133a-9d17-4ff9-839a-235b05f9dd93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:37 user nova-compute[71325]: INFO nova.compute.manager [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Attaching volume a790c3c4-c019-4667-acd2-5fd9108e7fdd to /dev/vdb
Apr 13 22:02:37 user nova-compute[71325]: DEBUG os_brick.utils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8791686-6e44-4858-abb7-03b63f1edd3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4667fe03-baf2-4dd7-83b8-740bc227f44e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-167b3898-6bba-4075-830e-2e9a5079e939 req-996d328d-6854-498e-9438-25588b91db6c service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Updated VIF entry in instance network info cache for port f00a6c25-29d8-4444-8128-ba174833d8fe. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-167b3898-6bba-4075-830e-2e9a5079e939 req-996d328d-6854-498e-9438-25588b91db6c service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Updating instance_info_cache with network_info: [{"id": "f00a6c25-29d8-4444-8128-ba174833d8fe", "address": "fa:16:3e:5c:ba:0a", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00a6c25-29", "ovs_interfaceid": "f00a6c25-29d8-4444-8128-ba174833d8fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0658f27-da57-42a2-a0aa-8abe8aae9892]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce844d1-4c10-4c67-9f23-9e261389e471]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-167b3898-6bba-4075-830e-2e9a5079e939 req-996d328d-6854-498e-9438-25588b91db6c service nova] Releasing lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:02:37 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:02:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[861e26a7-f6fa-4604-8176-d2d77c1e78bb]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG os_brick.utils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:02:37 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Updating existing volume attachment record: 69ab330c-5ade-4b19-b435-d85a6cf2ec96 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:02:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFcKWxVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:02:41 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:02:41 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:02:41 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4df44a8-412d-42f8-b97b-d1f6b7523241]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:02:41 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83119c3-b92b-4e15-96e8-888b11258962]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd] added
Apr 13 22:02:41 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddd5e94-2bef-4bc5-b667-63307bf6b170]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1c8fb6-8934-4af3-921e-91e7c273dbf1]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFcKWxVT {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFcKWxVT" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eefe7ad-7eac-43be-ab82-b690adb4ae7c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFcKWxVT'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[75586474-4822-4496-b15a-47c7e857099f]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c35709e-edda-47a8-b35d-77ad50fa0715]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:41 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:41 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:41 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:41 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:41 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:41 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b18380b-8c79-4900-9c7c-e5c87f78cbce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd, portal: 172.16.0.220,3260]
Apr 13 22:02:41 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd, portal: 172.16.0.220,3260] successful.
Apr 13 22:02:41 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d970b4-e00b-464c-98b0-9701eb589616]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3c2f8f-57a4-41a8-a688-eb1e2123c956]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:41 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:41 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:41 user nova-compute[71325]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd (non-flash)
Apr 13 22:02:41 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:41 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:41 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:41 user nova-compute[71325]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd (non-flash)
Apr 13 22:02:41 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e835846-ef83-40aa-a3a8-ce2269a0c6e4]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:41 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:02:42 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:02:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFcKWxVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:02:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:02:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26666613134323666', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:02:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666613134323666', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:02:42 user nova-compute[71325]: DEBUG nova.objects.instance [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lazy-loading 'flavor' on Instance uuid 061e133a-9d17-4ff9-839a-235b05f9dd93 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:02:43 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:02:43 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:02:43 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:02:43 user nova-compute[71325]:   <serial>a790c3c4-c019-4667-acd2-5fd9108e7fdd</serial>
Apr 13 22:02:43 user nova-compute[71325]: </disk>
Apr 13 22:02:43 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:02:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:02:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:02:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] No VIF found with MAC fa:16:3e:5c:ba:0a, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:02:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.365s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "15a855b1-8253-4b57-b675-edeee6a91511" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "15a855b1-8253-4b57-b675-edeee6a91511" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "15a855b1-8253-4b57-b675-edeee6a91511-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "15a855b1-8253-4b57-b675-edeee6a91511-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "15a855b1-8253-4b57-b675-edeee6a91511-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:46 user nova-compute[71325]: INFO nova.compute.manager [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Terminating instance
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "061e133a-9d17-4ff9-839a-235b05f9dd93" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:46 user nova-compute[71325]: INFO nova.compute.manager [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Detaching volume a790c3c4-c019-4667-acd2-5fd9108e7fdd
Apr 13 22:02:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:46 user nova-compute[71325]: INFO nova.virt.block_device [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Attempting to driver detach volume a790c3c4-c019-4667-acd2-5fd9108e7fdd from mountpoint /dev/vdb
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Attempting to detach device vdb from instance 061e133a-9d17-4ff9-839a-235b05f9dd93 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:02:46 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:02:46 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:02:46 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:02:46 user nova-compute[71325]:   <serial>a790c3c4-c019-4667-acd2-5fd9108e7fdd</serial>
Apr 13 22:02:46 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:02:46 user nova-compute[71325]: </disk>
Apr 13 22:02:46 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:02:46 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Successfully detached device vdb from instance 061e133a-9d17-4ff9-839a-235b05f9dd93 from the persistent domain config.
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 061e133a-9d17-4ff9-839a-235b05f9dd93 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:02:46 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:02:46 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:02:46 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:02:46 user nova-compute[71325]:   <serial>a790c3c4-c019-4667-acd2-5fd9108e7fdd</serial>
Apr 13 22:02:46 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:02:46 user nova-compute[71325]: </disk>
Apr 13 22:02:46 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-95f3bb28-a65f-4c6d-8d77-6c751bfe752a req-73cfcc71-7700-41ab-ba67-5e63907acda6 service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Received event network-vif-unplugged-a9ff5635-bea0-434b-bdb6-4004eefa847a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-95f3bb28-a65f-4c6d-8d77-6c751bfe752a req-73cfcc71-7700-41ab-ba67-5e63907acda6 service nova] Acquiring lock "15a855b1-8253-4b57-b675-edeee6a91511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-95f3bb28-a65f-4c6d-8d77-6c751bfe752a req-73cfcc71-7700-41ab-ba67-5e63907acda6 service nova] Lock "15a855b1-8253-4b57-b675-edeee6a91511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-95f3bb28-a65f-4c6d-8d77-6c751bfe752a req-73cfcc71-7700-41ab-ba67-5e63907acda6 service nova] Lock "15a855b1-8253-4b57-b675-edeee6a91511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-95f3bb28-a65f-4c6d-8d77-6c751bfe752a req-73cfcc71-7700-41ab-ba67-5e63907acda6 service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] No waiting events found dispatching network-vif-unplugged-a9ff5635-bea0-434b-bdb6-4004eefa847a {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-95f3bb28-a65f-4c6d-8d77-6c751bfe752a req-73cfcc71-7700-41ab-ba67-5e63907acda6 service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Received event network-vif-unplugged-a9ff5635-bea0-434b-bdb6-4004eefa847a for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "ada4ed22-c00b-47cd-885b-58d7eceff652" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "ada4ed22-c00b-47cd-885b-58d7eceff652" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:02:46 user nova-compute[71325]: INFO nova.compute.claims [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Claim successful on node user
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681423366.7213643, 061e133a-9d17-4ff9-839a-235b05f9dd93 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 061e133a-9d17-4ff9-839a-235b05f9dd93 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:02:46 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Successfully detached device vdb from instance 061e133a-9d17-4ff9-839a-235b05f9dd93 from the live domain config.
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFcKWxVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:02:46 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f09565a-0e2d-47df-a42f-358ed4773120]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:02:46 user nova-compute[71325]: No targets found.
Apr 13 22:02:46 user nova-compute[71325]: iSNS:
Apr 13 22:02:46 user nova-compute[71325]: No targets found.
Apr 13 22:02:46 user nova-compute[71325]: STATIC:
Apr 13 22:02:46 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd
Apr 13 22:02:46 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:02:46 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:02:46 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903
Apr 13 22:02:46 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:02:46 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:02:46 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 22:02:46 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:02:46 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:02:46 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409
Apr 13 22:02:46 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:02:46 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:02:46 user nova-compute[71325]: FIRMWARE:
Apr 13 22:02:46 user nova-compute[71325]: No targets found.
Apr 13 22:02:46 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:02:46 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:02:46 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f9407e-b04d-43dd-a443-46bed7c60bca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc6f9b3-180f-4817-985c-dd610889f6a6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:46 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:46 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:46 user nova-compute[71325]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd (non-flash)
Apr 13 22:02:46 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:46 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:46 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:46 user nova-compute[71325]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd (non-flash)
Apr 13 22:02:46 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d4bb4550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a957f0-eb60-4f5d-9267-066927b3c3a8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71439f8-5f76-4912-a2a8-d258197940ec]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c179d06a-e518-40c8-b1bc-f11a5c47ba3c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a66804-512d-480d-92f1-307cce7bb9ea]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7895ec26-ca2f-4144-8d25-82670bcb1c24]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:46 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:02:47 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Instance destroyed successfully.
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lazy-loading 'resources' on Instance uuid 15a855b1-8253-4b57-b675-edeee6a91511 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:58:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-782768086',display_name='tempest-TestVolumeBootPattern-volume-backed-server-782768086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-782768086',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:58:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-68n6ymkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:58:19Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=15a855b1-8253-4b57-b675-edeee6a91511,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "address": "fa:16:3e:ae:cb:c7", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ff5635-be", "ovs_interfaceid": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "address": "fa:16:3e:ae:cb:c7", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ff5635-be", "ovs_interfaceid": "a9ff5635-bea0-434b-bdb6-4004eefa847a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cb:c7,bridge_name='br-int',has_traffic_filtering=True,id=a9ff5635-bea0-434b-bdb6-4004eefa847a,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ff5635-be') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_vif [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cb:c7,bridge_name='br-int',has_traffic_filtering=True,id=a9ff5635-bea0-434b-bdb6-4004eefa847a,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ff5635-be') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e960f6-8519-4b42-8398-32b576751694]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd, portal: 172.16.0.220,3260]
Apr 13 22:02:47 user nova-compute[71325]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd, portal: 172.16.0.220,3260] successful.
Apr 13 22:02:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9ff5635-be, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:47 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:02:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:02:47 user nova-compute[71325]: INFO os_vif [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cb:c7,bridge_name='br-int',has_traffic_filtering=True,id=a9ff5635-bea0-434b-bdb6-4004eefa847a,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ff5635-be')
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgrbJmju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:02:47 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a790c3c4-c019-4667-acd2-5fd9108e7fdd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1def4102-b682-447d-83c1-489d458ad347]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] <== disconnect_volume: return (387ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.024s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[41766a81-d05f-49e4-a7ce-782c00fbed61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:02:47 user nova-compute[71325]: No targets found.
Apr 13 22:02:47 user nova-compute[71325]: iSNS:
Apr 13 22:02:47 user nova-compute[71325]: No targets found.
Apr 13 22:02:47 user nova-compute[71325]: STATIC:
Apr 13 22:02:47 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903
Apr 13 22:02:47 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:02:47 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:02:47 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 22:02:47 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:02:47 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:02:47 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409
Apr 13 22:02:47 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:02:47 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:02:47 user nova-compute[71325]: FIRMWARE:
Apr 13 22:02:47 user nova-compute[71325]: No targets found.
Apr 13 22:02:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:02:47 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:02:47 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cca396-e2d6-456c-822c-abdbb13902ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.policy [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74f2c0f-0d6b-4755-b659-69d5f12f2532]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:47 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:47 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:02:47 user nova-compute[71325]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 (non-flash)
Apr 13 22:02:47 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:02:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5a41e3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409'): ({'sdc'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Removing single pathed devices sdc {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d80c2a-791a-4350-a01b-d5977e1f7341]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:02:47 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Creating image(s)
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "/opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "/opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "/opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec7300b-a603-4778-91da-187504639dec]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flushing IO for device /dev/sdc {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65a3d40-de35-4f78-a219-b514d6c70822]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d58bc69-fea8-4f63-9aab-dce80270e4c2]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c32632b-a338-44b8-9719-8e501db88880]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be252ca-3d0a-48f8-a9a3-27e27b907bba]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409, portal: 172.16.0.220,3260]
Apr 13 22:02:47 user nova-compute[71325]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409, portal: 172.16.0.220,3260] successful.
Apr 13 22:02:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaa51d1-a9c7-4ca4-b76d-903304f71409 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b782dc-1b32-4cb6-bc07-cc2ce5ff86eb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.477s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== disconnect_volume: return (502ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:02:47 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Deleting instance files /opt/stack/data/nova/instances/15a855b1-8253-4b57-b675-edeee6a91511_del
Apr 13 22:02:47 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Deletion of /opt/stack/data/nova/instances/15a855b1-8253-4b57-b675-edeee6a91511_del complete
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk 1073741824" returned: 0 in 0.056s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: INFO nova.compute.manager [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Took 1.61 seconds to destroy the instance on the hypervisor.
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Cannot resize image /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'migration_context' on Instance uuid ada4ed22-c00b-47cd-885b-58d7eceff652 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Ensure instance console log exists: /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Successfully created port: 832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:02:47 user nova-compute[71325]: DEBUG nova.objects.instance [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lazy-loading 'flavor' on Instance uuid 061e133a-9d17-4ff9-839a-235b05f9dd93 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.888s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:48 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:02:48 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Took 0.52 seconds to deallocate network for instance.
Apr 13 22:02:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-e029bae7-187f-4f3e-aab6-3527d39d3c4e req-590a8356-b99f-4654-bf79-50643f5b9daf service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Received event network-vif-deleted-a9ff5635-bea0-434b-bdb6-4004eefa847a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:48 user nova-compute[71325]: INFO nova.compute.manager [req-e029bae7-187f-4f3e-aab6-3527d39d3c4e req-590a8356-b99f-4654-bf79-50643f5b9daf service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Neutron deleted interface a9ff5635-bea0-434b-bdb6-4004eefa847a; detaching it from the instance and deleting it from the info cache
Apr 13 22:02:48 user nova-compute[71325]: DEBUG nova.network.neutron [req-e029bae7-187f-4f3e-aab6-3527d39d3c4e req-590a8356-b99f-4654-bf79-50643f5b9daf service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:02:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-e029bae7-187f-4f3e-aab6-3527d39d3c4e req-590a8356-b99f-4654-bf79-50643f5b9daf service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Detach interface failed, port_id=a9ff5635-bea0-434b-bdb6-4004eefa847a, reason: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 22:02:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-e543be1d-03d6-4b5f-a57c-16d38e6ff7aa req-7047e743-1dd2-49c0-a21b-8c6dcf4ed5e3 service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Received event network-vif-plugged-a9ff5635-bea0-434b-bdb6-4004eefa847a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e543be1d-03d6-4b5f-a57c-16d38e6ff7aa req-7047e743-1dd2-49c0-a21b-8c6dcf4ed5e3 service nova] Acquiring lock "15a855b1-8253-4b57-b675-edeee6a91511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e543be1d-03d6-4b5f-a57c-16d38e6ff7aa req-7047e743-1dd2-49c0-a21b-8c6dcf4ed5e3 service nova] Lock "15a855b1-8253-4b57-b675-edeee6a91511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e543be1d-03d6-4b5f-a57c-16d38e6ff7aa req-7047e743-1dd2-49c0-a21b-8c6dcf4ed5e3 service nova] Lock "15a855b1-8253-4b57-b675-edeee6a91511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-e543be1d-03d6-4b5f-a57c-16d38e6ff7aa req-7047e743-1dd2-49c0-a21b-8c6dcf4ed5e3 service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] No waiting events found dispatching network-vif-plugged-a9ff5635-bea0-434b-bdb6-4004eefa847a {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:02:48 user nova-compute[71325]: WARNING nova.compute.manager [req-e543be1d-03d6-4b5f-a57c-16d38e6ff7aa req-7047e743-1dd2-49c0-a21b-8c6dcf4ed5e3 service nova] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Received unexpected event network-vif-plugged-a9ff5635-bea0-434b-bdb6-4004eefa847a for instance with vm_state active and task_state deleting.
Apr 13 22:02:48 user nova-compute[71325]: INFO nova.compute.manager [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Took 0.76 seconds to detach 1 volumes for instance.
Apr 13 22:02:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Deleting volume: 6eaa51d1-a9c7-4ca4-b76d-903304f71409 {{(pid=71325) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Successfully updated port: 832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquired lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:49 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Deleted allocations for instance 15a855b1-8253-4b57-b675-edeee6a91511
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Updating instance_info_cache with network_info: [{"id": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "address": "fa:16:3e:98:81:ee", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832e1c7c-c4", "ovs_interfaceid": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Releasing lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Instance network_info: |[{"id": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "address": "fa:16:3e:98:81:ee", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832e1c7c-c4", "ovs_interfaceid": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Start _get_guest_xml network_info=[{"id": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "address": "fa:16:3e:98:81:ee", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832e1c7c-c4", "ovs_interfaceid": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:02:49 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:02:49 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-964549732',display_name='tempest-ServerActionsTestJSON-server-964549732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-964549732',id=36,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-8vq87rjj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:02:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=ada4ed22-c00b-47cd-885b-58d7eceff652,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "address": "fa:16:3e:98:81:ee", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832e1c7c-c4", "ovs_interfaceid": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "address": "fa:16:3e:98:81:ee", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832e1c7c-c4", "ovs_interfaceid": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:81:ee,bridge_name='br-int',has_traffic_filtering=True,id=832e1c7c-c4ab-4265-8173-6aa27ed74a1e,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap832e1c7c-c4') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'pci_devices' on Instance uuid ada4ed22-c00b-47cd-885b-58d7eceff652 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "15a855b1-8253-4b57-b675-edeee6a91511" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.444s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:02:49 user nova-compute[71325]:   <uuid>ada4ed22-c00b-47cd-885b-58d7eceff652</uuid>
Apr 13 22:02:49 user nova-compute[71325]:   <name>instance-00000024</name>
Apr 13 22:02:49 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:02:49 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:02:49 user nova-compute[71325]:   <metadata>
Apr 13 22:02:49 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:02:49 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:02:49 user nova-compute[71325]:       <nova:name>tempest-ServerActionsTestJSON-server-964549732</nova:name>
Apr 13 22:02:49 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:02:49</nova:creationTime>
Apr 13 22:02:49 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:02:49 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:02:49 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:02:49 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:02:49 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:02:49 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:02:49 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:02:49 user nova-compute[71325]:       <nova:owner>
Apr 13 22:02:49 user nova-compute[71325]:         <nova:user uuid="b3db8b01a05b43f68bfd8695253514db">tempest-ServerActionsTestJSON-236976022-project-member</nova:user>
Apr 13 22:02:49 user nova-compute[71325]:         <nova:project uuid="7c086cffbafb4da68f172ab27da232d3">tempest-ServerActionsTestJSON-236976022</nova:project>
Apr 13 22:02:49 user nova-compute[71325]:       </nova:owner>
Apr 13 22:02:49 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 22:02:49 user nova-compute[71325]:       <nova:ports>
Apr 13 22:02:49 user nova-compute[71325]:         <nova:port uuid="832e1c7c-c4ab-4265-8173-6aa27ed74a1e">
Apr 13 22:02:49 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 22:02:49 user nova-compute[71325]:         </nova:port>
Apr 13 22:02:49 user nova-compute[71325]:       </nova:ports>
Apr 13 22:02:49 user nova-compute[71325]:     </nova:instance>
Apr 13 22:02:49 user nova-compute[71325]:   </metadata>
Apr 13 22:02:49 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:02:49 user nova-compute[71325]:     <system>
Apr 13 22:02:49 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:02:49 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:02:49 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:02:49 user nova-compute[71325]:       <entry name="serial">ada4ed22-c00b-47cd-885b-58d7eceff652</entry>
Apr 13 22:02:49 user nova-compute[71325]:       <entry name="uuid">ada4ed22-c00b-47cd-885b-58d7eceff652</entry>
Apr 13 22:02:49 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:02:49 user nova-compute[71325]:     </system>
Apr 13 22:02:49 user nova-compute[71325]:   </sysinfo>
Apr 13 22:02:49 user nova-compute[71325]:   <os>
Apr 13 22:02:49 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:02:49 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:02:49 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:02:49 user nova-compute[71325]:   </os>
Apr 13 22:02:49 user nova-compute[71325]:   <features>
Apr 13 22:02:49 user nova-compute[71325]:     <acpi/>
Apr 13 22:02:49 user nova-compute[71325]:     <apic/>
Apr 13 22:02:49 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:02:49 user nova-compute[71325]:   </features>
Apr 13 22:02:49 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:02:49 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:02:49 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:02:49 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:02:49 user nova-compute[71325]:   </clock>
Apr 13 22:02:49 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:02:49 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:02:49 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:02:49 user nova-compute[71325]:   </cpu>
Apr 13 22:02:49 user nova-compute[71325]:   <devices>
Apr 13 22:02:49 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 22:02:49 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:02:49 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk"/>
Apr 13 22:02:49 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:02:49 user nova-compute[71325]:     </disk>
Apr 13 22:02:49 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:02:49 user nova-compute[71325]:       <mac address="fa:16:3e:98:81:ee"/>
Apr 13 22:02:49 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:02:49 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:02:49 user nova-compute[71325]:       <target dev="tap832e1c7c-c4"/>
Apr 13 22:02:49 user nova-compute[71325]:     </interface>
Apr 13 22:02:49 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:02:49 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/console.log" append="off"/>
Apr 13 22:02:49 user nova-compute[71325]:     </serial>
Apr 13 22:02:49 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:02:49 user nova-compute[71325]:     <video>
Apr 13 22:02:49 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:02:49 user nova-compute[71325]:     </video>
Apr 13 22:02:49 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:02:49 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:02:49 user nova-compute[71325]:     </rng>
Apr 13 22:02:49 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:02:49 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:02:49 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:02:49 user nova-compute[71325]:     </memballoon>
Apr 13 22:02:49 user nova-compute[71325]:   </devices>
Apr 13 22:02:49 user nova-compute[71325]: </domain>
Apr 13 22:02:49 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-964549732',display_name='tempest-ServerActionsTestJSON-server-964549732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-964549732',id=36,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-8vq87rjj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:02:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=ada4ed22-c00b-47cd-885b-58d7eceff652,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "address": "fa:16:3e:98:81:ee", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832e1c7c-c4", "ovs_interfaceid": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "address": "fa:16:3e:98:81:ee", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832e1c7c-c4", "ovs_interfaceid": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:81:ee,bridge_name='br-int',has_traffic_filtering=True,id=832e1c7c-c4ab-4265-8173-6aa27ed74a1e,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap832e1c7c-c4') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG os_vif [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:81:ee,bridge_name='br-int',has_traffic_filtering=True,id=832e1c7c-c4ab-4265-8173-6aa27ed74a1e,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap832e1c7c-c4') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap832e1c7c-c4, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap832e1c7c-c4, col_values=(('external_ids', {'iface-id': '832e1c7c-c4ab-4265-8173-6aa27ed74a1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:81:ee', 'vm-uuid': 'ada4ed22-c00b-47cd-885b-58d7eceff652'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:49 user nova-compute[71325]: INFO os_vif [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:81:ee,bridge_name='br-int',has_traffic_filtering=True,id=832e1c7c-c4ab-4265-8173-6aa27ed74a1e,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap832e1c7c-c4')
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:02:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No VIF found with MAC fa:16:3e:98:81:ee, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:02:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:50 user nova-compute[71325]: DEBUG nova.compute.manager [req-022e29b1-d7d5-4d09-ad21-80536812a9d4 req-11125767-4e9a-45bc-a1db-baf9871d275a service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Received event network-changed-832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:50 user nova-compute[71325]: DEBUG nova.compute.manager [req-022e29b1-d7d5-4d09-ad21-80536812a9d4 req-11125767-4e9a-45bc-a1db-baf9871d275a service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Refreshing instance network info cache due to event network-changed-832e1c7c-c4ab-4265-8173-6aa27ed74a1e. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:02:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-022e29b1-d7d5-4d09-ad21-80536812a9d4 req-11125767-4e9a-45bc-a1db-baf9871d275a service nova] Acquiring lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:02:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-022e29b1-d7d5-4d09-ad21-80536812a9d4 req-11125767-4e9a-45bc-a1db-baf9871d275a service nova] Acquired lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:02:50 user nova-compute[71325]: DEBUG nova.network.neutron [req-022e29b1-d7d5-4d09-ad21-80536812a9d4 req-11125767-4e9a-45bc-a1db-baf9871d275a service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Refreshing network info cache for port 832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:02:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:51 user nova-compute[71325]: DEBUG nova.network.neutron [req-022e29b1-d7d5-4d09-ad21-80536812a9d4 req-11125767-4e9a-45bc-a1db-baf9871d275a service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Updated VIF entry in instance network info cache for port 832e1c7c-c4ab-4265-8173-6aa27ed74a1e. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:02:51 user nova-compute[71325]: DEBUG nova.network.neutron [req-022e29b1-d7d5-4d09-ad21-80536812a9d4 req-11125767-4e9a-45bc-a1db-baf9871d275a service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Updating instance_info_cache with network_info: [{"id": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "address": "fa:16:3e:98:81:ee", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832e1c7c-c4", "ovs_interfaceid": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:02:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-022e29b1-d7d5-4d09-ad21-80536812a9d4 req-11125767-4e9a-45bc-a1db-baf9871d275a service nova] Releasing lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:02:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Received event network-vif-plugged-832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] Acquiring lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] Lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] Lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] No waiting events found dispatching network-vif-plugged-832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:02:52 user nova-compute[71325]: WARNING nova.compute.manager [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Received unexpected event network-vif-plugged-832e1c7c-c4ab-4265-8173-6aa27ed74a1e for instance with vm_state building and task_state spawning.
Apr 13 22:02:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Received event network-vif-plugged-832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:02:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] Acquiring lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:02:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] Lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:02:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] Lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] No waiting events found dispatching network-vif-plugged-832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:02:52 user nova-compute[71325]: WARNING nova.compute.manager [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Received unexpected event network-vif-plugged-832e1c7c-c4ab-4265-8173-6aa27ed74a1e for instance with vm_state building and task_state spawning.
Apr 13 22:02:52 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423372.986829, ada4ed22-c00b-47cd-885b-58d7eceff652 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:02:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] VM Resumed (Lifecycle Event)
Apr 13 22:02:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:02:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:02:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Instance spawned successfully.
Apr 13 22:02:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:02:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:02:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:02:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:02:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:02:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:02:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:02:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:02:53 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:02:53 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:02:53 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423372.988941, ada4ed22-c00b-47cd-885b-58d7eceff652 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:02:53 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] VM Started (Lifecycle Event)
Apr 13 22:02:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:02:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:02:53 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:02:53 user nova-compute[71325]: INFO nova.compute.manager [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Took 5.84 seconds to spawn the instance on the hypervisor.
Apr 13 22:02:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:02:53 user nova-compute[71325]: INFO nova.compute.manager [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Took 6.61 seconds to build instance.
Apr 13 22:02:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "ada4ed22-c00b-47cd-885b-58d7eceff652" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.728s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:02:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:02:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:02 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423367.0540457, 15a855b1-8253-4b57-b675-edeee6a91511 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:03:02 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] VM Stopped (Lifecycle Event)
Apr 13 22:03:02 user nova-compute[71325]: DEBUG nova.compute.manager [None req-274272f1-5deb-438d-88d5-35cbf6eeef9b None None] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:03 user nova-compute[71325]: INFO nova.compute.manager [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Terminating instance
Apr 13 22:03:03 user nova-compute[71325]: DEBUG nova.compute.manager [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG nova.compute.manager [req-ba5871fc-20a3-4107-baf1-bd5e36f11fcb req-2603211f-9ece-4e2a-adda-edf4ac9082a0 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Received event network-vif-unplugged-b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ba5871fc-20a3-4107-baf1-bd5e36f11fcb req-2603211f-9ece-4e2a-adda-edf4ac9082a0 service nova] Acquiring lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ba5871fc-20a3-4107-baf1-bd5e36f11fcb req-2603211f-9ece-4e2a-adda-edf4ac9082a0 service nova] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ba5871fc-20a3-4107-baf1-bd5e36f11fcb req-2603211f-9ece-4e2a-adda-edf4ac9082a0 service nova] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG nova.compute.manager [req-ba5871fc-20a3-4107-baf1-bd5e36f11fcb req-2603211f-9ece-4e2a-adda-edf4ac9082a0 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] No waiting events found dispatching network-vif-unplugged-b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:03:03 user nova-compute[71325]: DEBUG nova.compute.manager [req-ba5871fc-20a3-4107-baf1-bd5e36f11fcb req-2603211f-9ece-4e2a-adda-edf4ac9082a0 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Received event network-vif-unplugged-b2a829d9-30f3-4537-8cd8-610561188ec1 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:03:04 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Instance destroyed successfully.
Apr 13 22:03:04 user nova-compute[71325]: DEBUG nova.objects.instance [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'resources' on Instance uuid 37c5f603-6f39-4fc7-a86e-be1b6cebde5b {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:03:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1306572424',display_name='tempest-AttachVolumeNegativeTest-server-1306572424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1306572424',id=32,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjiikkEbrTg/WryaLvM1VDBK+suc/5Dwvx4Vdfw0N4JZlXsBGsrIYAKH3AVlUtKrIJJ9MHQm23G5QpUddzkgRiVYi6Zqn9zRRQGQMAPCalG/ExBhF8Y3ZVyscy/IXA5kg==',key_name='tempest-keypair-1140702761',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:00:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='446b51db737947ab9bddd5fc47488bc7',ramdisk_id='',reservation_id='r-3na75uah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-920375840',owner_user_name='tempest-AttachVolumeNegativeTest-920375840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:00:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145c0a177fcc4b94b5480d8806554ac9',uuid=37c5f603-6f39-4fc7-a86e-be1b6cebde5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2a829d9-30f3-4537-8cd8-610561188ec1", "address": "fa:16:3e:0b:fa:8b", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a829d9-30", "ovs_interfaceid": "b2a829d9-30f3-4537-8cd8-610561188ec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:03:04 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converting VIF {"id": "b2a829d9-30f3-4537-8cd8-610561188ec1", "address": "fa:16:3e:0b:fa:8b", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a829d9-30", "ovs_interfaceid": "b2a829d9-30f3-4537-8cd8-610561188ec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:03:04 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:fa:8b,bridge_name='br-int',has_traffic_filtering=True,id=b2a829d9-30f3-4537-8cd8-610561188ec1,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a829d9-30') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:03:04 user nova-compute[71325]: DEBUG os_vif [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:fa:8b,bridge_name='br-int',has_traffic_filtering=True,id=b2a829d9-30f3-4537-8cd8-610561188ec1,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a829d9-30') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:03:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2a829d9-30, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:03:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:03:04 user nova-compute[71325]: INFO os_vif [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:fa:8b,bridge_name='br-int',has_traffic_filtering=True,id=b2a829d9-30f3-4537-8cd8-610561188ec1,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a829d9-30')
Apr 13 22:03:04 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Deleting instance files /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b_del
Apr 13 22:03:04 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Deletion of /opt/stack/data/nova/instances/37c5f603-6f39-4fc7-a86e-be1b6cebde5b_del complete
Apr 13 22:03:04 user nova-compute[71325]: INFO nova.compute.manager [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 13 22:03:04 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:03:04 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:03:04 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:03:05 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:03:05 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Took 1.00 seconds to deallocate network for instance.
Apr 13 22:03:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-43caae0f-1c35-4fd0-b5bd-00290fe19767 req-b2f2935f-573d-4fe4-a4fd-42e4bcb9a9a6 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Received event network-vif-deleted-b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:03:05 user nova-compute[71325]: INFO nova.compute.manager [req-43caae0f-1c35-4fd0-b5bd-00290fe19767 req-b2f2935f-573d-4fe4-a4fd-42e4bcb9a9a6 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Neutron deleted interface b2a829d9-30f3-4537-8cd8-610561188ec1; detaching it from the instance and deleting it from the info cache
Apr 13 22:03:05 user nova-compute[71325]: DEBUG nova.network.neutron [req-43caae0f-1c35-4fd0-b5bd-00290fe19767 req-b2f2935f-573d-4fe4-a4fd-42e4bcb9a9a6 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:03:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-43caae0f-1c35-4fd0-b5bd-00290fe19767 req-b2f2935f-573d-4fe4-a4fd-42e4bcb9a9a6 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Detach interface failed, port_id=b2a829d9-30f3-4537-8cd8-610561188ec1, reason: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 22:03:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:05 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:03:05 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:03:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:05 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Deleted allocations for instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b
Apr 13 22:03:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.329s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-3724bd69-20d3-4a42-97f0-162e903338a5 req-b7c4232d-3dea-4c4d-8f79-368ca3761a05 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Received event network-vif-plugged-b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:03:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3724bd69-20d3-4a42-97f0-162e903338a5 req-b7c4232d-3dea-4c4d-8f79-368ca3761a05 service nova] Acquiring lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3724bd69-20d3-4a42-97f0-162e903338a5 req-b7c4232d-3dea-4c4d-8f79-368ca3761a05 service nova] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3724bd69-20d3-4a42-97f0-162e903338a5 req-b7c4232d-3dea-4c4d-8f79-368ca3761a05 service nova] Lock "37c5f603-6f39-4fc7-a86e-be1b6cebde5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:05 user nova-compute[71325]: DEBUG nova.compute.manager [req-3724bd69-20d3-4a42-97f0-162e903338a5 req-b7c4232d-3dea-4c4d-8f79-368ca3761a05 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] No waiting events found dispatching network-vif-plugged-b2a829d9-30f3-4537-8cd8-610561188ec1 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:03:05 user nova-compute[71325]: WARNING nova.compute.manager [req-3724bd69-20d3-4a42-97f0-162e903338a5 req-b7c4232d-3dea-4c4d-8f79-368ca3761a05 service nova] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Received unexpected event network-vif-plugged-b2a829d9-30f3-4537-8cd8-610561188ec1 for instance with vm_state deleted and task_state None.
Apr 13 22:03:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:14 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:03:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:03:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:03:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-bfcfa307-25f3-43e0-837b-704b5cd7783f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:03:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-bfcfa307-25f3-43e0-837b-704b5cd7783f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:03:15 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:03:16 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Updating instance_info_cache with network_info: [{"id": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "address": "fa:16:3e:0c:02:5e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4855a-44", "ovs_interfaceid": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:03:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-bfcfa307-25f3-43e0-837b-704b5cd7783f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:03:16 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:03:16 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:03:16 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:03:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:16 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:03:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:03:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:18 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:03:18 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:03:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8024MB free_disk=26.065521240234375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance bfcfa307-25f3-43e0-837b-704b5cd7783f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance e874e1c2-9dd4-4ca5-b273-abd35526d921 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ada4ed22-c00b-47cd-885b-58d7eceff652 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:03:18 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:03:19 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423384.0940595, 37c5f603-6f39-4fc7-a86e-be1b6cebde5b => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:03:19 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] VM Stopped (Lifecycle Event)
Apr 13 22:03:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c0c1d479-8777-4ba6-bafa-71f78f205fb9 None None] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:03:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:19 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:03:19 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:03:19 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:03:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:03:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:03:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:03:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:03:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:24 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:03:24 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:03:26 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:03:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:03:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:03:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:03:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:03:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:03:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:03:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:03:39 user nova-compute[71325]: INFO nova.compute.manager [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] instance snapshotting
Apr 13 22:03:39 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Beginning live snapshot process
Apr 13 22:03:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json -f qcow2 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json -f qcow2" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json -f qcow2 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json -f qcow2" returned: 0 in 0.317s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2oeyfr8h/c71e490e731c40f58d24989e8515afe0.delta 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2oeyfr8h/c71e490e731c40f58d24989e8515afe0.delta 1073741824" returned: 0 in 0.053s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:40 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 22:03:41 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:03:41 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:03:41 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 22:03:42 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 22:03:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2oeyfr8h/c71e490e731c40f58d24989e8515afe0.delta /opt/stack/data/nova/instances/snapshots/tmp2oeyfr8h/c71e490e731c40f58d24989e8515afe0 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2oeyfr8h/c71e490e731c40f58d24989e8515afe0.delta /opt/stack/data/nova/instances/snapshots/tmp2oeyfr8h/c71e490e731c40f58d24989e8515afe0" returned: 0 in 0.618s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Snapshot extracted, beginning image upload
Apr 13 22:03:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:03:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:43 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:03:43 user nova-compute[71325]: INFO nova.compute.claims [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Claim successful on node user
Apr 13 22:03:44 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG nova.network.neutron [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:03:44 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:03:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:03:44 user nova-compute[71325]: INFO nova.virt.block_device [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Booting with volume 5fa56af9-4ad3-47b4-8234-7ad286b5647f at /dev/vda
Apr 13 22:03:44 user nova-compute[71325]: DEBUG os_brick.utils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d512564-f48c-428e-8d00-fad9834f9253]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a933cbb2-a919-44be-8d28-bc9002966f70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da85c3d-a1d4-4185-932d-339881a5307d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1326dbf-4cdd-4d67-9871-99b524e18a73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG nova.policy [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:03:44 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:03:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[20838230-e70e-4059-a743-dac96418990f]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG os_brick.utils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:03:44 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Updating existing volume attachment record: 0050a421-a5db-4f1a-9c0d-f7d9bd8a6163 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:03:45 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Snapshot image upload complete
Apr 13 22:03:45 user nova-compute[71325]: INFO nova.compute.manager [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Took 5.27 seconds to snapshot the instance on the hypervisor.
Apr 13 22:03:45 user nova-compute[71325]: DEBUG nova.network.neutron [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Successfully created port: 71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:03:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:47 user nova-compute[71325]: DEBUG nova.network.neutron [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Successfully updated port: 71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:03:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "refresh_cache-fc6cc27b-3d35-44e3-97dd-aac5a596d21c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:03:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquired lock "refresh_cache-fc6cc27b-3d35-44e3-97dd-aac5a596d21c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:03:47 user nova-compute[71325]: DEBUG nova.network.neutron [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:03:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-d5d4d574-972d-441b-9169-3d24ab37a944 req-8adcde65-6457-4aba-a5a9-57a4e232a859 service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Received event network-changed-71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:03:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-d5d4d574-972d-441b-9169-3d24ab37a944 req-8adcde65-6457-4aba-a5a9-57a4e232a859 service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Refreshing instance network info cache due to event network-changed-71388612-8dc7-4935-b3d2-489e3d4b171e. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:03:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d5d4d574-972d-441b-9169-3d24ab37a944 req-8adcde65-6457-4aba-a5a9-57a4e232a859 service nova] Acquiring lock "refresh_cache-fc6cc27b-3d35-44e3-97dd-aac5a596d21c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:03:47 user nova-compute[71325]: DEBUG nova.network.neutron [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:03:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:48 user nova-compute[71325]: DEBUG nova.network.neutron [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Updating instance_info_cache with network_info: [{"id": "71388612-8dc7-4935-b3d2-489e3d4b171e", "address": "fa:16:3e:52:d6:82", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71388612-8d", "ovs_interfaceid": "71388612-8dc7-4935-b3d2-489e3d4b171e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:03:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Releasing lock "refresh_cache-fc6cc27b-3d35-44e3-97dd-aac5a596d21c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:03:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Instance network_info: |[{"id": "71388612-8dc7-4935-b3d2-489e3d4b171e", "address": "fa:16:3e:52:d6:82", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71388612-8d", "ovs_interfaceid": "71388612-8dc7-4935-b3d2-489e3d4b171e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:03:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d5d4d574-972d-441b-9169-3d24ab37a944 req-8adcde65-6457-4aba-a5a9-57a4e232a859 service nova] Acquired lock "refresh_cache-fc6cc27b-3d35-44e3-97dd-aac5a596d21c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:03:48 user nova-compute[71325]: DEBUG nova.network.neutron [req-d5d4d574-972d-441b-9169-3d24ab37a944 req-8adcde65-6457-4aba-a5a9-57a4e232a859 service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Refreshing network info cache for port 71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.compute.manager [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:03:49 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Creating image(s)
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Ensure instance console log exists: /opt/stack/data/nova/instances/fc6cc27b-3d35-44e3-97dd-aac5a596d21c/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Start _get_guest_xml network_info=[{"id": "71388612-8dc7-4935-b3d2-489e3d4b171e", "address": "fa:16:3e:52:d6:82", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71388612-8d", "ovs_interfaceid": "71388612-8dc7-4935-b3d2-489e3d4b171e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHjyYtwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc6cc27b-3d35-44e3-97dd-aac5a596d21c', 'attached_at': '', 'detached_at': '', 'volume_id': '5fa56af9-4ad3-47b4-8234-7ad286b5647f', 'serial': '5fa56af9-4ad3-47b4-8234-7ad286b5647f'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '0050a421-a5db-4f1a-9c0d-f7d9bd8a6163', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:03:49 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:03:49 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHjyYtwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:03:49 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:03:49 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:03:49 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.network.neutron [req-d5d4d574-972d-441b-9169-3d24ab37a944 req-8adcde65-6457-4aba-a5a9-57a4e232a859 service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Updated VIF entry in instance network info cache for port 71388612-8dc7-4935-b3d2-489e3d4b171e. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.network.neutron [req-d5d4d574-972d-441b-9169-3d24ab37a944 req-8adcde65-6457-4aba-a5a9-57a4e232a859 service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Updating instance_info_cache with network_info: [{"id": "71388612-8dc7-4935-b3d2-489e3d4b171e", "address": "fa:16:3e:52:d6:82", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71388612-8d", "ovs_interfaceid": "71388612-8dc7-4935-b3d2-489e3d4b171e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d5d4d574-972d-441b-9169-3d24ab37a944 req-8adcde65-6457-4aba-a5a9-57a4e232a859 service nova] Releasing lock "refresh_cache-fc6cc27b-3d35-44e3-97dd-aac5a596d21c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba08ad3-8d33-4a51-a2b0-7ff3bee2b1c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:03:49 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[511579c1-e006-4cde-9b85-d6bd747647a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f] added
Apr 13 22:03:49 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a096b2dd-2ddb-44cb-915e-6c476915d4bd]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0b0874-c8f4-4a95-8b6a-1c782987bb78]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHjyYtwS {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHjyYtwS" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c4c327-8d13-41d0-a1ca-6f6da963923f]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AHjyYtwS'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[799d16f8-6ecb-4606-9b1a-903bdf7fbbda]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e50335d-1f55-4e14-90c7-3409f8f97c86]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:03:49 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:03:49 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:03:49 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:03:49 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04ad026-21d7-4de5-a0bd-7eb1d2e62d07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260]
Apr 13 22:03:49 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260] successful.
Apr 13 22:03:49 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d906bb5-4953-49dd-bd31-c516f7645cc9]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7da037f-87df-4a22-80b8-90dfe8c05d7d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:03:49 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:03:49 user nova-compute[71325]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:03:49 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:03:49 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:03:49 user nova-compute[71325]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:03:49 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87f93cc-26f9-4974-8c27-5d2e38207ca1]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHjyYtwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.compute.manager [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:49 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:03:49 user nova-compute[71325]: INFO nova.compute.claims [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Claim successful on node user
Apr 13 22:03:50 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:03:50 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:03:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:03:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:03:50 user nova-compute[71325]: DEBUG nova.network.neutron [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:03:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:03:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:03:50 user nova-compute[71325]: DEBUG nova.policy [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26fb3ecc54c84118b2100ff89cbc87f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388f228079fa45cb91fa08b972132fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:03:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:03:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:03:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Creating image(s)
Apr 13 22:03:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "/opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "/opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "/opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "53b20199cadec147fb841d690b3a18f0baf528aa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "53b20199cadec147fb841d690b3a18f0baf528aa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa.part --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.727s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== connect_volume: return (1730ms) {'type': 'block', 'scsi_wwn': '23134306438653163', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134306438653163', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.network.neutron [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Successfully created port: 2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1352949408',display_name='tempest-TestVolumeBootPattern-server-1352949408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1352949408',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORfhunB7LA94/Vo0IeX5uHg0BK3ZrJIdCSr/QNts93zg201FlS6UuD5bquQQY3opSX8Ui/7/1jLECj4NoRXCObFsyJekLp1y4HjowC79e9IEN0rtSp6qQ2huNvtbuOLUg==',key_name='tempest-TestVolumeBootPattern-949568181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-3tx1ccv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:03:44Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=fc6cc27b-3d35-44e3-97dd-aac5a596d21c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71388612-8dc7-4935-b3d2-489e3d4b171e", "address": "fa:16:3e:52:d6:82", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71388612-8d", "ovs_interfaceid": "71388612-8dc7-4935-b3d2-489e3d4b171e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "71388612-8dc7-4935-b3d2-489e3d4b171e", "address": "fa:16:3e:52:d6:82", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71388612-8d", "ovs_interfaceid": "71388612-8dc7-4935-b3d2-489e3d4b171e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:d6:82,bridge_name='br-int',has_traffic_filtering=True,id=71388612-8dc7-4935-b3d2-489e3d4b171e,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71388612-8d') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.objects.instance [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lazy-loading 'pci_devices' on Instance uuid fc6cc27b-3d35-44e3-97dd-aac5a596d21c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:03:51 user nova-compute[71325]:   <uuid>fc6cc27b-3d35-44e3-97dd-aac5a596d21c</uuid>
Apr 13 22:03:51 user nova-compute[71325]:   <name>instance-00000025</name>
Apr 13 22:03:51 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:03:51 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:03:51 user nova-compute[71325]:   <metadata>
Apr 13 22:03:51 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:03:51 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:03:51 user nova-compute[71325]:       <nova:name>tempest-TestVolumeBootPattern-server-1352949408</nova:name>
Apr 13 22:03:51 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:03:49</nova:creationTime>
Apr 13 22:03:51 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:03:51 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:03:51 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:03:51 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:03:51 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:03:51 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:03:51 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:03:51 user nova-compute[71325]:       <nova:owner>
Apr 13 22:03:51 user nova-compute[71325]:         <nova:user uuid="50a8a5f433c94e0c9ba4d6ecea37d756">tempest-TestVolumeBootPattern-1335483698-project-member</nova:user>
Apr 13 22:03:51 user nova-compute[71325]:         <nova:project uuid="ad824150d99044c6ab1c7829cbe01de5">tempest-TestVolumeBootPattern-1335483698</nova:project>
Apr 13 22:03:51 user nova-compute[71325]:       </nova:owner>
Apr 13 22:03:51 user nova-compute[71325]:       <nova:ports>
Apr 13 22:03:51 user nova-compute[71325]:         <nova:port uuid="71388612-8dc7-4935-b3d2-489e3d4b171e">
Apr 13 22:03:51 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 22:03:51 user nova-compute[71325]:         </nova:port>
Apr 13 22:03:51 user nova-compute[71325]:       </nova:ports>
Apr 13 22:03:51 user nova-compute[71325]:     </nova:instance>
Apr 13 22:03:51 user nova-compute[71325]:   </metadata>
Apr 13 22:03:51 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:03:51 user nova-compute[71325]:     <system>
Apr 13 22:03:51 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:03:51 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:03:51 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:03:51 user nova-compute[71325]:       <entry name="serial">fc6cc27b-3d35-44e3-97dd-aac5a596d21c</entry>
Apr 13 22:03:51 user nova-compute[71325]:       <entry name="uuid">fc6cc27b-3d35-44e3-97dd-aac5a596d21c</entry>
Apr 13 22:03:51 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:03:51 user nova-compute[71325]:     </system>
Apr 13 22:03:51 user nova-compute[71325]:   </sysinfo>
Apr 13 22:03:51 user nova-compute[71325]:   <os>
Apr 13 22:03:51 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:03:51 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:03:51 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:03:51 user nova-compute[71325]:   </os>
Apr 13 22:03:51 user nova-compute[71325]:   <features>
Apr 13 22:03:51 user nova-compute[71325]:     <acpi/>
Apr 13 22:03:51 user nova-compute[71325]:     <apic/>
Apr 13 22:03:51 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:03:51 user nova-compute[71325]:   </features>
Apr 13 22:03:51 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:03:51 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:03:51 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:03:51 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:03:51 user nova-compute[71325]:   </clock>
Apr 13 22:03:51 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:03:51 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:03:51 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:03:51 user nova-compute[71325]:   </cpu>
Apr 13 22:03:51 user nova-compute[71325]:   <devices>
Apr 13 22:03:51 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 22:03:51 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:03:51 user nova-compute[71325]:       <source dev="/dev/sdb"/>
Apr 13 22:03:51 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:03:51 user nova-compute[71325]:       <serial>5fa56af9-4ad3-47b4-8234-7ad286b5647f</serial>
Apr 13 22:03:51 user nova-compute[71325]:     </disk>
Apr 13 22:03:51 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:03:51 user nova-compute[71325]:       <mac address="fa:16:3e:52:d6:82"/>
Apr 13 22:03:51 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:03:51 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:03:51 user nova-compute[71325]:       <target dev="tap71388612-8d"/>
Apr 13 22:03:51 user nova-compute[71325]:     </interface>
Apr 13 22:03:51 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:03:51 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/fc6cc27b-3d35-44e3-97dd-aac5a596d21c/console.log" append="off"/>
Apr 13 22:03:51 user nova-compute[71325]:     </serial>
Apr 13 22:03:51 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:03:51 user nova-compute[71325]:     <video>
Apr 13 22:03:51 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:03:51 user nova-compute[71325]:     </video>
Apr 13 22:03:51 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:03:51 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:03:51 user nova-compute[71325]:     </rng>
Apr 13 22:03:51 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:03:51 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:03:51 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:03:51 user nova-compute[71325]:     </memballoon>
Apr 13 22:03:51 user nova-compute[71325]:   </devices>
Apr 13 22:03:51 user nova-compute[71325]: </domain>
Apr 13 22:03:51 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1352949408',display_name='tempest-TestVolumeBootPattern-server-1352949408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1352949408',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORfhunB7LA94/Vo0IeX5uHg0BK3ZrJIdCSr/QNts93zg201FlS6UuD5bquQQY3opSX8Ui/7/1jLECj4NoRXCObFsyJekLp1y4HjowC79e9IEN0rtSp6qQ2huNvtbuOLUg==',key_name='tempest-TestVolumeBootPattern-949568181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-3tx1ccv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:03:44Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=fc6cc27b-3d35-44e3-97dd-aac5a596d21c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71388612-8dc7-4935-b3d2-489e3d4b171e", "address": "fa:16:3e:52:d6:82", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71388612-8d", "ovs_interfaceid": "71388612-8dc7-4935-b3d2-489e3d4b171e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "71388612-8dc7-4935-b3d2-489e3d4b171e", "address": "fa:16:3e:52:d6:82", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71388612-8d", "ovs_interfaceid": "71388612-8dc7-4935-b3d2-489e3d4b171e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:d6:82,bridge_name='br-int',has_traffic_filtering=True,id=71388612-8dc7-4935-b3d2-489e3d4b171e,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71388612-8d') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG os_vif [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:d6:82,bridge_name='br-int',has_traffic_filtering=True,id=71388612-8dc7-4935-b3d2-489e3d4b171e,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71388612-8d') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71388612-8d, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71388612-8d, col_values=(('external_ids', {'iface-id': '71388612-8dc7-4935-b3d2-489e3d4b171e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:d6:82', 'vm-uuid': 'fc6cc27b-3d35-44e3-97dd-aac5a596d21c'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:51 user nova-compute[71325]: INFO os_vif [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:d6:82,bridge_name='br-int',has_traffic_filtering=True,id=71388612-8dc7-4935-b3d2-489e3d4b171e,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71388612-8d')
Apr 13 22:03:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa.part --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.virt.images [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] bd40dedc-e511-4505-afbf-c9ff13ef51b7 was qcow2, converting to raw {{(pid=71325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.privsep.utils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa.part /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa.converted {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] No VIF found with MAC fa:16:3e:52:d6:82, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa.part /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa.converted" returned: 0 in 0.530s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa.converted --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa.converted --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "53b20199cadec147fb841d690b3a18f0baf528aa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.463s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.network.neutron [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Successfully updated port: 2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "refresh_cache-940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquired lock "refresh_cache-940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.network.neutron [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-179ea4b6-f4e6-4ce9-825e-ca73f2417fa4 req-8bf4a919-dadf-46e5-b679-ea98057cd2a8 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Received event network-changed-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG nova.compute.manager [req-179ea4b6-f4e6-4ce9-825e-ca73f2417fa4 req-8bf4a919-dadf-46e5-b679-ea98057cd2a8 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Refreshing instance network info cache due to event network-changed-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-179ea4b6-f4e6-4ce9-825e-ca73f2417fa4 req-8bf4a919-dadf-46e5-b679-ea98057cd2a8 service nova] Acquiring lock "refresh_cache-940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "53b20199cadec147fb841d690b3a18f0baf528aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "53b20199cadec147fb841d690b3a18f0baf528aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.network.neutron [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa,backing_fmt=raw /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa,backing_fmt=raw /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk 1073741824" returned: 0 in 0.048s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "53b20199cadec147fb841d690b3a18f0baf528aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa --force-share --output=json" returned: 0 in 0.132s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.objects.instance [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lazy-loading 'migration_context' on Instance uuid 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Ensure instance console log exists: /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.network.neutron [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Updating instance_info_cache with network_info: [{"id": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "address": "fa:16:3e:a8:57:54", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee4b50e-d2", "ovs_interfaceid": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Releasing lock "refresh_cache-940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Instance network_info: |[{"id": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "address": "fa:16:3e:a8:57:54", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee4b50e-d2", "ovs_interfaceid": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-179ea4b6-f4e6-4ce9-825e-ca73f2417fa4 req-8bf4a919-dadf-46e5-b679-ea98057cd2a8 service nova] Acquired lock "refresh_cache-940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.network.neutron [req-179ea4b6-f4e6-4ce9-825e-ca73f2417fa4 req-8bf4a919-dadf-46e5-b679-ea98057cd2a8 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Refreshing network info cache for port 2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Start _get_guest_xml network_info=[{"id": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "address": "fa:16:3e:a8:57:54", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee4b50e-d2", "ovs_interfaceid": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a32d456c590f6c62d20ec3975c2512bd',container_format='bare',created_at=2023-04-13T22:03:39Z,direct_url=<?>,disk_format='qcow2',id=bd40dedc-e511-4505-afbf-c9ff13ef51b7,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1335681012',owner='388f228079fa45cb91fa08b972132fbe',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-13T22:03:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'bd40dedc-e511-4505-afbf-c9ff13ef51b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:03:52 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:03:52 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a32d456c590f6c62d20ec3975c2512bd',container_format='bare',created_at=2023-04-13T22:03:39Z,direct_url=<?>,disk_format='qcow2',id=bd40dedc-e511-4505-afbf-c9ff13ef51b7,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1335681012',owner='388f228079fa45cb91fa08b972132fbe',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-13T22:03:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2025917295',display_name='tempest-TestStampPattern-server-2025917295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2025917295',id=38,image_ref='bd40dedc-e511-4505-afbf-c9ff13ef51b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXtPnwsWU/ZHWadHD9KufzgH+i4W8Whaj89/zf4/lU/5gVOUN68ru0UJiR7TrTwJrSHaGj3qTP3uSclSDGLdxNe17FiKyjg0p2Imd/q5wAr6DX4FJCcSqsRDbLL7AtxQA==',key_name='tempest-TestStampPattern-369348447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='388f228079fa45cb91fa08b972132fbe',ramdisk_id='',reservation_id='r-hmq6j8fb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='061e133a-9d17-4ff9-839a-235b05f9dd93',image_min_disk='1',image_min_ram='0',image_owner_id='388f228079fa45cb91fa08b972132fbe',image_owner_project_name='tempest-TestStampPattern-921591052',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-921591052-project-member',image_user_id='26fb3ecc54c84118b2100ff89cbc87f6',network_allocated='True',owner_project_name='tempest-TestStampPattern-921591052',owner_user_name='tempest-TestStampPattern-921591052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:03:50Z,user_data=None,user_id='26fb3ecc54c84118b2100ff89cbc87f6',uuid=940ee3fc-f7d5-4f22-a3c8-6e4e15018b78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "address": "fa:16:3e:a8:57:54", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee4b50e-d2", "ovs_interfaceid": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Converting VIF {"id": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "address": "fa:16:3e:a8:57:54", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee4b50e-d2", "ovs_interfaceid": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:57:54,bridge_name='br-int',has_traffic_filtering=True,id=2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb,network=Network(a5cfb4cb-723b-4476-8849-b693ce8adbe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee4b50e-d2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.objects.instance [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lazy-loading 'pci_devices' on Instance uuid 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:03:52 user nova-compute[71325]:   <uuid>940ee3fc-f7d5-4f22-a3c8-6e4e15018b78</uuid>
Apr 13 22:03:52 user nova-compute[71325]:   <name>instance-00000026</name>
Apr 13 22:03:52 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:03:52 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:03:52 user nova-compute[71325]:   <metadata>
Apr 13 22:03:52 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:03:52 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:03:52 user nova-compute[71325]:       <nova:name>tempest-TestStampPattern-server-2025917295</nova:name>
Apr 13 22:03:52 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:03:52</nova:creationTime>
Apr 13 22:03:52 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:03:52 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:03:52 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:03:52 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:03:52 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:03:52 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:03:52 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:03:52 user nova-compute[71325]:       <nova:owner>
Apr 13 22:03:52 user nova-compute[71325]:         <nova:user uuid="26fb3ecc54c84118b2100ff89cbc87f6">tempest-TestStampPattern-921591052-project-member</nova:user>
Apr 13 22:03:52 user nova-compute[71325]:         <nova:project uuid="388f228079fa45cb91fa08b972132fbe">tempest-TestStampPattern-921591052</nova:project>
Apr 13 22:03:52 user nova-compute[71325]:       </nova:owner>
Apr 13 22:03:52 user nova-compute[71325]:       <nova:root type="image" uuid="bd40dedc-e511-4505-afbf-c9ff13ef51b7"/>
Apr 13 22:03:52 user nova-compute[71325]:       <nova:ports>
Apr 13 22:03:52 user nova-compute[71325]:         <nova:port uuid="2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb">
Apr 13 22:03:52 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 22:03:52 user nova-compute[71325]:         </nova:port>
Apr 13 22:03:52 user nova-compute[71325]:       </nova:ports>
Apr 13 22:03:52 user nova-compute[71325]:     </nova:instance>
Apr 13 22:03:52 user nova-compute[71325]:   </metadata>
Apr 13 22:03:52 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:03:52 user nova-compute[71325]:     <system>
Apr 13 22:03:52 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:03:52 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:03:52 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:03:52 user nova-compute[71325]:       <entry name="serial">940ee3fc-f7d5-4f22-a3c8-6e4e15018b78</entry>
Apr 13 22:03:52 user nova-compute[71325]:       <entry name="uuid">940ee3fc-f7d5-4f22-a3c8-6e4e15018b78</entry>
Apr 13 22:03:52 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:03:52 user nova-compute[71325]:     </system>
Apr 13 22:03:52 user nova-compute[71325]:   </sysinfo>
Apr 13 22:03:52 user nova-compute[71325]:   <os>
Apr 13 22:03:52 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:03:52 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:03:52 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:03:52 user nova-compute[71325]:   </os>
Apr 13 22:03:52 user nova-compute[71325]:   <features>
Apr 13 22:03:52 user nova-compute[71325]:     <acpi/>
Apr 13 22:03:52 user nova-compute[71325]:     <apic/>
Apr 13 22:03:52 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:03:52 user nova-compute[71325]:   </features>
Apr 13 22:03:52 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:03:52 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:03:52 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:03:52 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:03:52 user nova-compute[71325]:   </clock>
Apr 13 22:03:52 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:03:52 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:03:52 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:03:52 user nova-compute[71325]:   </cpu>
Apr 13 22:03:52 user nova-compute[71325]:   <devices>
Apr 13 22:03:52 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 22:03:52 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:03:52 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk"/>
Apr 13 22:03:52 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:03:52 user nova-compute[71325]:     </disk>
Apr 13 22:03:52 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:03:52 user nova-compute[71325]:       <mac address="fa:16:3e:a8:57:54"/>
Apr 13 22:03:52 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:03:52 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:03:52 user nova-compute[71325]:       <target dev="tap2ee4b50e-d2"/>
Apr 13 22:03:52 user nova-compute[71325]:     </interface>
Apr 13 22:03:52 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:03:52 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/console.log" append="off"/>
Apr 13 22:03:52 user nova-compute[71325]:     </serial>
Apr 13 22:03:52 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:03:52 user nova-compute[71325]:     <video>
Apr 13 22:03:52 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:03:52 user nova-compute[71325]:     </video>
Apr 13 22:03:52 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:03:52 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:03:52 user nova-compute[71325]:     </rng>
Apr 13 22:03:52 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:03:52 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:03:52 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:03:52 user nova-compute[71325]:     </memballoon>
Apr 13 22:03:52 user nova-compute[71325]:   </devices>
Apr 13 22:03:52 user nova-compute[71325]: </domain>
Apr 13 22:03:52 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2025917295',display_name='tempest-TestStampPattern-server-2025917295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2025917295',id=38,image_ref='bd40dedc-e511-4505-afbf-c9ff13ef51b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXtPnwsWU/ZHWadHD9KufzgH+i4W8Whaj89/zf4/lU/5gVOUN68ru0UJiR7TrTwJrSHaGj3qTP3uSclSDGLdxNe17FiKyjg0p2Imd/q5wAr6DX4FJCcSqsRDbLL7AtxQA==',key_name='tempest-TestStampPattern-369348447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='388f228079fa45cb91fa08b972132fbe',ramdisk_id='',reservation_id='r-hmq6j8fb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='061e133a-9d17-4ff9-839a-235b05f9dd93',image_min_disk='1',image_min_ram='0',image_owner_id='388f228079fa45cb91fa08b972132fbe',image_owner_project_name='tempest-TestStampPattern-921591052',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-921591052-project-member',image_user_id='26fb3ecc54c84118b2100ff89cbc87f6',network_allocated='True',owner_project_name='tempest-TestStampPattern-921591052',owner_user_name='tempest-TestStampPattern-921591052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:03:50Z,user_data=None,user_id='26fb3ecc54c84118b2100ff89cbc87f6',uuid=940ee3fc-f7d5-4f22-a3c8-6e4e15018b78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "address": "fa:16:3e:a8:57:54", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee4b50e-d2", "ovs_interfaceid": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Converting VIF {"id": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "address": "fa:16:3e:a8:57:54", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee4b50e-d2", "ovs_interfaceid": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:57:54,bridge_name='br-int',has_traffic_filtering=True,id=2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb,network=Network(a5cfb4cb-723b-4476-8849-b693ce8adbe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee4b50e-d2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG os_vif [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:57:54,bridge_name='br-int',has_traffic_filtering=True,id=2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb,network=Network(a5cfb4cb-723b-4476-8849-b693ce8adbe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee4b50e-d2') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ee4b50e-d2, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ee4b50e-d2, col_values=(('external_ids', {'iface-id': '2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:57:54', 'vm-uuid': '940ee3fc-f7d5-4f22-a3c8-6e4e15018b78'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:52 user nova-compute[71325]: INFO os_vif [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:57:54,bridge_name='br-int',has_traffic_filtering=True,id=2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb,network=Network(a5cfb4cb-723b-4476-8849-b693ce8adbe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee4b50e-d2')
Apr 13 22:03:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] No VIF found with MAC fa:16:3e:a8:57:54, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:03:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-ff0b1681-59b8-4e61-898b-eee07005bee0 req-928a3ebe-ef94-4ca4-8af9-fc90410681d1 service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Received event network-vif-plugged-71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:03:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ff0b1681-59b8-4e61-898b-eee07005bee0 req-928a3ebe-ef94-4ca4-8af9-fc90410681d1 service nova] Acquiring lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ff0b1681-59b8-4e61-898b-eee07005bee0 req-928a3ebe-ef94-4ca4-8af9-fc90410681d1 service nova] Lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ff0b1681-59b8-4e61-898b-eee07005bee0 req-928a3ebe-ef94-4ca4-8af9-fc90410681d1 service nova] Lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-ff0b1681-59b8-4e61-898b-eee07005bee0 req-928a3ebe-ef94-4ca4-8af9-fc90410681d1 service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] No waiting events found dispatching network-vif-plugged-71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:03:53 user nova-compute[71325]: WARNING nova.compute.manager [req-ff0b1681-59b8-4e61-898b-eee07005bee0 req-928a3ebe-ef94-4ca4-8af9-fc90410681d1 service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Received unexpected event network-vif-plugged-71388612-8dc7-4935-b3d2-489e3d4b171e for instance with vm_state building and task_state spawning.
Apr 13 22:03:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:53 user nova-compute[71325]: DEBUG nova.network.neutron [req-179ea4b6-f4e6-4ce9-825e-ca73f2417fa4 req-8bf4a919-dadf-46e5-b679-ea98057cd2a8 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Updated VIF entry in instance network info cache for port 2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:03:53 user nova-compute[71325]: DEBUG nova.network.neutron [req-179ea4b6-f4e6-4ce9-825e-ca73f2417fa4 req-8bf4a919-dadf-46e5-b679-ea98057cd2a8 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Updating instance_info_cache with network_info: [{"id": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "address": "fa:16:3e:a8:57:54", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee4b50e-d2", "ovs_interfaceid": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:03:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-179ea4b6-f4e6-4ce9-825e-ca73f2417fa4 req-8bf4a919-dadf-46e5-b679-ea98057cd2a8 service nova] Releasing lock "refresh_cache-940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:03:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-c9457475-4967-4dbe-9728-67bb1bcba421 req-18f28417-cc6e-40c7-8a8d-8e8fb58111db service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Received event network-vif-plugged-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:03:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c9457475-4967-4dbe-9728-67bb1bcba421 req-18f28417-cc6e-40c7-8a8d-8e8fb58111db service nova] Acquiring lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c9457475-4967-4dbe-9728-67bb1bcba421 req-18f28417-cc6e-40c7-8a8d-8e8fb58111db service nova] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c9457475-4967-4dbe-9728-67bb1bcba421 req-18f28417-cc6e-40c7-8a8d-8e8fb58111db service nova] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-c9457475-4967-4dbe-9728-67bb1bcba421 req-18f28417-cc6e-40c7-8a8d-8e8fb58111db service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] No waiting events found dispatching network-vif-plugged-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:03:54 user nova-compute[71325]: WARNING nova.compute.manager [req-c9457475-4967-4dbe-9728-67bb1bcba421 req-18f28417-cc6e-40c7-8a8d-8e8fb58111db service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Received unexpected event network-vif-plugged-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb for instance with vm_state building and task_state spawning.
Apr 13 22:03:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-49bfd3bc-ac65-48e7-a4ad-ce41c298b2b0 req-3a2b554c-0a99-4252-a6e1-543616af8f7c service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Received event network-vif-plugged-71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:03:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49bfd3bc-ac65-48e7-a4ad-ce41c298b2b0 req-3a2b554c-0a99-4252-a6e1-543616af8f7c service nova] Acquiring lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49bfd3bc-ac65-48e7-a4ad-ce41c298b2b0 req-3a2b554c-0a99-4252-a6e1-543616af8f7c service nova] Lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49bfd3bc-ac65-48e7-a4ad-ce41c298b2b0 req-3a2b554c-0a99-4252-a6e1-543616af8f7c service nova] Lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-49bfd3bc-ac65-48e7-a4ad-ce41c298b2b0 req-3a2b554c-0a99-4252-a6e1-543616af8f7c service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] No waiting events found dispatching network-vif-plugged-71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:03:55 user nova-compute[71325]: WARNING nova.compute.manager [req-49bfd3bc-ac65-48e7-a4ad-ce41c298b2b0 req-3a2b554c-0a99-4252-a6e1-543616af8f7c service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Received unexpected event network-vif-plugged-71388612-8dc7-4935-b3d2-489e3d4b171e for instance with vm_state building and task_state spawning.
Apr 13 22:03:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423435.9169326, fc6cc27b-3d35-44e3-97dd-aac5a596d21c => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:03:55 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] VM Resumed (Lifecycle Event)
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:03:55 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Instance spawned successfully.
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:03:55 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423435.9203997, fc6cc27b-3d35-44e3-97dd-aac5a596d21c => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:03:55 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] VM Started (Lifecycle Event)
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:03:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:03:56 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:03:56 user nova-compute[71325]: INFO nova.compute.manager [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Took 6.84 seconds to spawn the instance on the hypervisor.
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:03:56 user nova-compute[71325]: INFO nova.compute.manager [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Took 12.37 seconds to build instance.
Apr 13 22:03:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.469s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423436.5098622, 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:03:56 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] VM Resumed (Lifecycle Event)
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:03:56 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Instance spawned successfully.
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:03:56 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423436.511059, 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:03:56 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] VM Started (Lifecycle Event)
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:03:56 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:03:56 user nova-compute[71325]: INFO nova.compute.manager [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Took 6.27 seconds to spawn the instance on the hypervisor.
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.compute.manager [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:03:56 user nova-compute[71325]: INFO nova.compute.manager [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Took 7.01 seconds to build instance.
Apr 13 22:03:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.129s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.compute.manager [req-b648ded3-fe30-4af1-b89c-f8447598f7f4 req-2bdbfc4b-baf2-4d9a-a136-100e4e8bcd90 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Received event network-vif-plugged-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:03:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b648ded3-fe30-4af1-b89c-f8447598f7f4 req-2bdbfc4b-baf2-4d9a-a136-100e4e8bcd90 service nova] Acquiring lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b648ded3-fe30-4af1-b89c-f8447598f7f4 req-2bdbfc4b-baf2-4d9a-a136-100e4e8bcd90 service nova] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b648ded3-fe30-4af1-b89c-f8447598f7f4 req-2bdbfc4b-baf2-4d9a-a136-100e4e8bcd90 service nova] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:56 user nova-compute[71325]: DEBUG nova.compute.manager [req-b648ded3-fe30-4af1-b89c-f8447598f7f4 req-2bdbfc4b-baf2-4d9a-a136-100e4e8bcd90 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] No waiting events found dispatching network-vif-plugged-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:03:56 user nova-compute[71325]: WARNING nova.compute.manager [req-b648ded3-fe30-4af1-b89c-f8447598f7f4 req-2bdbfc4b-baf2-4d9a-a136-100e4e8bcd90 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Received unexpected event network-vif-plugged-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb for instance with vm_state active and task_state None.
Apr 13 22:03:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:03:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "e568023a-3163-428f-8b1a-6c854c65f46f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "e568023a-3163-428f-8b1a-6c854c65f46f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:58 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:03:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:58 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:03:58 user nova-compute[71325]: INFO nova.compute.claims [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Claim successful on node user
Apr 13 22:03:58 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:03:58 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:03:59 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:03:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG nova.policy [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:03:59 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Creating image(s)
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "/opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "/opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "/opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.153s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.158s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk 1073741824" returned: 0 in 0.071s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:03:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Successfully created port: 45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Cannot resize image /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG nova.objects.instance [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'migration_context' on Instance uuid e568023a-3163-428f-8b1a-6c854c65f46f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Ensure instance console log exists: /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Successfully updated port: 45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "refresh_cache-e568023a-3163-428f-8b1a-6c854c65f46f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquired lock "refresh_cache-e568023a-3163-428f-8b1a-6c854c65f46f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-aa4a9364-f914-46f5-9f33-c5bebe7320ec req-b8c4a39c-5f11-4ff4-a634-d03fbb954777 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Received event network-changed-45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-aa4a9364-f914-46f5-9f33-c5bebe7320ec req-b8c4a39c-5f11-4ff4-a634-d03fbb954777 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Refreshing instance network info cache due to event network-changed-45ea22f6-3663-4d12-a479-41c56f1e9bc2. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aa4a9364-f914-46f5-9f33-c5bebe7320ec req-b8c4a39c-5f11-4ff4-a634-d03fbb954777 service nova] Acquiring lock "refresh_cache-e568023a-3163-428f-8b1a-6c854c65f46f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:04:00 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.network.neutron [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Updating instance_info_cache with network_info: [{"id": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "address": "fa:16:3e:9e:73:66", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ea22f6-36", "ovs_interfaceid": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Releasing lock "refresh_cache-e568023a-3163-428f-8b1a-6c854c65f46f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Instance network_info: |[{"id": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "address": "fa:16:3e:9e:73:66", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ea22f6-36", "ovs_interfaceid": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aa4a9364-f914-46f5-9f33-c5bebe7320ec req-b8c4a39c-5f11-4ff4-a634-d03fbb954777 service nova] Acquired lock "refresh_cache-e568023a-3163-428f-8b1a-6c854c65f46f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.network.neutron [req-aa4a9364-f914-46f5-9f33-c5bebe7320ec req-b8c4a39c-5f11-4ff4-a634-d03fbb954777 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Refreshing network info cache for port 45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Start _get_guest_xml network_info=[{"id": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "address": "fa:16:3e:9e:73:66", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ea22f6-36", "ovs_interfaceid": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:04:01 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:04:01 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-43325764',display_name='tempest-AttachVolumeNegativeTest-server-43325764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-43325764',id=39,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAseL4vxxUJqHfcsgelGZfQ5WSQkMbZV0oNUO7DZ0FmjlJimVjmfBMqZLB9Ro1KBgPzyb7m0hg9gAAFNGEPJ4EP6mvcIQ5RqNpMjHJWx3kG1AmT1sGEoeSLLPvqrv6FT+g==',key_name='tempest-keypair-548852854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446b51db737947ab9bddd5fc47488bc7',ramdisk_id='',reservation_id='r-vsi34luj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-920375840',owner_user_name='tempest-AttachVolumeNegativeTest-920375840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145c0a177fcc4b94b5480d8806554ac9',uuid=e568023a-3163-428f-8b1a-6c854c65f46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "address": "fa:16:3e:9e:73:66", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ea22f6-36", "ovs_interfaceid": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converting VIF {"id": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "address": "fa:16:3e:9e:73:66", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ea22f6-36", "ovs_interfaceid": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:73:66,bridge_name='br-int',has_traffic_filtering=True,id=45ea22f6-3663-4d12-a479-41c56f1e9bc2,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ea22f6-36') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.objects.instance [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'pci_devices' on Instance uuid e568023a-3163-428f-8b1a-6c854c65f46f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:04:01 user nova-compute[71325]:   <uuid>e568023a-3163-428f-8b1a-6c854c65f46f</uuid>
Apr 13 22:04:01 user nova-compute[71325]:   <name>instance-00000027</name>
Apr 13 22:04:01 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:04:01 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:04:01 user nova-compute[71325]:   <metadata>
Apr 13 22:04:01 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:04:01 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:04:01 user nova-compute[71325]:       <nova:name>tempest-AttachVolumeNegativeTest-server-43325764</nova:name>
Apr 13 22:04:01 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:04:01</nova:creationTime>
Apr 13 22:04:01 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:04:01 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:04:01 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:04:01 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:04:01 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:04:01 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:04:01 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:04:01 user nova-compute[71325]:       <nova:owner>
Apr 13 22:04:01 user nova-compute[71325]:         <nova:user uuid="145c0a177fcc4b94b5480d8806554ac9">tempest-AttachVolumeNegativeTest-920375840-project-member</nova:user>
Apr 13 22:04:01 user nova-compute[71325]:         <nova:project uuid="446b51db737947ab9bddd5fc47488bc7">tempest-AttachVolumeNegativeTest-920375840</nova:project>
Apr 13 22:04:01 user nova-compute[71325]:       </nova:owner>
Apr 13 22:04:01 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 22:04:01 user nova-compute[71325]:       <nova:ports>
Apr 13 22:04:01 user nova-compute[71325]:         <nova:port uuid="45ea22f6-3663-4d12-a479-41c56f1e9bc2">
Apr 13 22:04:01 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 22:04:01 user nova-compute[71325]:         </nova:port>
Apr 13 22:04:01 user nova-compute[71325]:       </nova:ports>
Apr 13 22:04:01 user nova-compute[71325]:     </nova:instance>
Apr 13 22:04:01 user nova-compute[71325]:   </metadata>
Apr 13 22:04:01 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:04:01 user nova-compute[71325]:     <system>
Apr 13 22:04:01 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:04:01 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:04:01 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:04:01 user nova-compute[71325]:       <entry name="serial">e568023a-3163-428f-8b1a-6c854c65f46f</entry>
Apr 13 22:04:01 user nova-compute[71325]:       <entry name="uuid">e568023a-3163-428f-8b1a-6c854c65f46f</entry>
Apr 13 22:04:01 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:04:01 user nova-compute[71325]:     </system>
Apr 13 22:04:01 user nova-compute[71325]:   </sysinfo>
Apr 13 22:04:01 user nova-compute[71325]:   <os>
Apr 13 22:04:01 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:04:01 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:04:01 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:04:01 user nova-compute[71325]:   </os>
Apr 13 22:04:01 user nova-compute[71325]:   <features>
Apr 13 22:04:01 user nova-compute[71325]:     <acpi/>
Apr 13 22:04:01 user nova-compute[71325]:     <apic/>
Apr 13 22:04:01 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:04:01 user nova-compute[71325]:   </features>
Apr 13 22:04:01 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:04:01 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:04:01 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:04:01 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:04:01 user nova-compute[71325]:   </clock>
Apr 13 22:04:01 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:04:01 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:04:01 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:04:01 user nova-compute[71325]:   </cpu>
Apr 13 22:04:01 user nova-compute[71325]:   <devices>
Apr 13 22:04:01 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 22:04:01 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:04:01 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk"/>
Apr 13 22:04:01 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:04:01 user nova-compute[71325]:     </disk>
Apr 13 22:04:01 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:04:01 user nova-compute[71325]:       <mac address="fa:16:3e:9e:73:66"/>
Apr 13 22:04:01 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:04:01 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:04:01 user nova-compute[71325]:       <target dev="tap45ea22f6-36"/>
Apr 13 22:04:01 user nova-compute[71325]:     </interface>
Apr 13 22:04:01 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:04:01 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/console.log" append="off"/>
Apr 13 22:04:01 user nova-compute[71325]:     </serial>
Apr 13 22:04:01 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:04:01 user nova-compute[71325]:     <video>
Apr 13 22:04:01 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:04:01 user nova-compute[71325]:     </video>
Apr 13 22:04:01 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:04:01 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:04:01 user nova-compute[71325]:     </rng>
Apr 13 22:04:01 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:04:01 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:04:01 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:04:01 user nova-compute[71325]:     </memballoon>
Apr 13 22:04:01 user nova-compute[71325]:   </devices>
Apr 13 22:04:01 user nova-compute[71325]: </domain>
Apr 13 22:04:01 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-43325764',display_name='tempest-AttachVolumeNegativeTest-server-43325764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-43325764',id=39,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAseL4vxxUJqHfcsgelGZfQ5WSQkMbZV0oNUO7DZ0FmjlJimVjmfBMqZLB9Ro1KBgPzyb7m0hg9gAAFNGEPJ4EP6mvcIQ5RqNpMjHJWx3kG1AmT1sGEoeSLLPvqrv6FT+g==',key_name='tempest-keypair-548852854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446b51db737947ab9bddd5fc47488bc7',ramdisk_id='',reservation_id='r-vsi34luj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-920375840',owner_user_name='tempest-AttachVolumeNegativeTest-920375840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145c0a177fcc4b94b5480d8806554ac9',uuid=e568023a-3163-428f-8b1a-6c854c65f46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "address": "fa:16:3e:9e:73:66", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ea22f6-36", "ovs_interfaceid": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converting VIF {"id": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "address": "fa:16:3e:9e:73:66", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ea22f6-36", "ovs_interfaceid": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:73:66,bridge_name='br-int',has_traffic_filtering=True,id=45ea22f6-3663-4d12-a479-41c56f1e9bc2,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ea22f6-36') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG os_vif [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:73:66,bridge_name='br-int',has_traffic_filtering=True,id=45ea22f6-3663-4d12-a479-41c56f1e9bc2,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ea22f6-36') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45ea22f6-36, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45ea22f6-36, col_values=(('external_ids', {'iface-id': '45ea22f6-3663-4d12-a479-41c56f1e9bc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:73:66', 'vm-uuid': 'e568023a-3163-428f-8b1a-6c854c65f46f'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:01 user nova-compute[71325]: INFO os_vif [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:73:66,bridge_name='br-int',has_traffic_filtering=True,id=45ea22f6-3663-4d12-a479-41c56f1e9bc2,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ea22f6-36')
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No VIF found with MAC fa:16:3e:9e:73:66, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.network.neutron [req-aa4a9364-f914-46f5-9f33-c5bebe7320ec req-b8c4a39c-5f11-4ff4-a634-d03fbb954777 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Updated VIF entry in instance network info cache for port 45ea22f6-3663-4d12-a479-41c56f1e9bc2. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG nova.network.neutron [req-aa4a9364-f914-46f5-9f33-c5bebe7320ec req-b8c4a39c-5f11-4ff4-a634-d03fbb954777 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Updating instance_info_cache with network_info: [{"id": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "address": "fa:16:3e:9e:73:66", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ea22f6-36", "ovs_interfaceid": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:04:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aa4a9364-f914-46f5-9f33-c5bebe7320ec req-b8c4a39c-5f11-4ff4-a634-d03fbb954777 service nova] Releasing lock "refresh_cache-e568023a-3163-428f-8b1a-6c854c65f46f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:04:02 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:02 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:02 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:02 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:02 user nova-compute[71325]: DEBUG nova.compute.manager [req-f146a289-df80-461d-a30a-da25fdc33e56 req-3b1c5d5e-fc92-4a37-8ccd-fc2d449d7d90 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Received event network-vif-plugged-45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f146a289-df80-461d-a30a-da25fdc33e56 req-3b1c5d5e-fc92-4a37-8ccd-fc2d449d7d90 service nova] Acquiring lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f146a289-df80-461d-a30a-da25fdc33e56 req-3b1c5d5e-fc92-4a37-8ccd-fc2d449d7d90 service nova] Lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f146a289-df80-461d-a30a-da25fdc33e56 req-3b1c5d5e-fc92-4a37-8ccd-fc2d449d7d90 service nova] Lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:02 user nova-compute[71325]: DEBUG nova.compute.manager [req-f146a289-df80-461d-a30a-da25fdc33e56 req-3b1c5d5e-fc92-4a37-8ccd-fc2d449d7d90 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] No waiting events found dispatching network-vif-plugged-45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:04:02 user nova-compute[71325]: WARNING nova.compute.manager [req-f146a289-df80-461d-a30a-da25fdc33e56 req-3b1c5d5e-fc92-4a37-8ccd-fc2d449d7d90 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Received unexpected event network-vif-plugged-45ea22f6-3663-4d12-a479-41c56f1e9bc2 for instance with vm_state building and task_state spawning.
Apr 13 22:04:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.compute.manager [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:04:04 user nova-compute[71325]: INFO nova.compute.claims [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Claim successful on node user
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423444.9255102, e568023a-3163-428f-8b1a-6c854c65f46f => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:04:04 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] VM Resumed (Lifecycle Event)
Apr 13 22:04:04 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Instance spawned successfully.
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.compute.manager [req-9ce5c80b-7fef-40de-bc7a-141cfcfd16f3 req-1905493b-1e08-4a75-b481-e1b9aa95cd2d service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Received event network-vif-plugged-45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9ce5c80b-7fef-40de-bc7a-141cfcfd16f3 req-1905493b-1e08-4a75-b481-e1b9aa95cd2d service nova] Acquiring lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9ce5c80b-7fef-40de-bc7a-141cfcfd16f3 req-1905493b-1e08-4a75-b481-e1b9aa95cd2d service nova] Lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9ce5c80b-7fef-40de-bc7a-141cfcfd16f3 req-1905493b-1e08-4a75-b481-e1b9aa95cd2d service nova] Lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.compute.manager [req-9ce5c80b-7fef-40de-bc7a-141cfcfd16f3 req-1905493b-1e08-4a75-b481-e1b9aa95cd2d service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] No waiting events found dispatching network-vif-plugged-45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:04:04 user nova-compute[71325]: WARNING nova.compute.manager [req-9ce5c80b-7fef-40de-bc7a-141cfcfd16f3 req-1905493b-1e08-4a75-b481-e1b9aa95cd2d service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Received unexpected event network-vif-plugged-45ea22f6-3663-4d12-a479-41c56f1e9bc2 for instance with vm_state building and task_state spawning.
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:04:04 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:04:04 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423444.926455, e568023a-3163-428f-8b1a-6c854c65f46f => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:04:04 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] VM Started (Lifecycle Event)
Apr 13 22:04:05 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:04:05 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:04:05 user nova-compute[71325]: INFO nova.compute.manager [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Took 5.79 seconds to spawn the instance on the hypervisor.
Apr 13 22:04:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:04:05 user nova-compute[71325]: INFO nova.compute.manager [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Took 6.62 seconds to build instance.
Apr 13 22:04:05 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "e568023a-3163-428f-8b1a-6c854c65f46f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.729s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:04:05 user nova-compute[71325]: INFO nova.virt.block_device [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Booting with volume 23dc11c8-0976-4037-a188-9067c88d8f0a at /dev/vda
Apr 13 22:04:05 user nova-compute[71325]: DEBUG nova.policy [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8ba9f99764b4e61ac0ed632000fc672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c57e44d2f456cab919015f4b9bb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG os_brick.utils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c281f8d-a664-478c-bc5e-fafbe84a9fa0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cab2e4-3002-4425-be49-19d116e768ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd3f185-4ef4-450e-843e-872f72c01851]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0484e749-cc25-428a-8791-ca3c21f7f1ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:04:05 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:04:05 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[760ce05d-c058-4160-bf1d-6bff1f30a7db]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG os_brick.utils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updating existing volume attachment record: f02baae2-5f2c-432e-831d-41611008d23e {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:04:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Successfully created port: 9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:04:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:06 user nova-compute[71325]: DEBUG nova.network.neutron [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Successfully updated port: 9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:04:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:04:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquired lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:04:06 user nova-compute[71325]: DEBUG nova.network.neutron [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:04:06 user nova-compute[71325]: DEBUG nova.network.neutron [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:04:07 user nova-compute[71325]: DEBUG nova.compute.manager [req-aaf6bebd-1a75-422d-b380-c5bf63d51de6 req-b2cf1a59-80dd-494e-9a30-acae9bddceab service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-changed-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:07 user nova-compute[71325]: DEBUG nova.compute.manager [req-aaf6bebd-1a75-422d-b380-c5bf63d51de6 req-b2cf1a59-80dd-494e-9a30-acae9bddceab service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Refreshing instance network info cache due to event network-changed-9bbf8f11-4979-445b-b429-c2b404283afc. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:04:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aaf6bebd-1a75-422d-b380-c5bf63d51de6 req-b2cf1a59-80dd-494e-9a30-acae9bddceab service nova] Acquiring lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:04:07 user nova-compute[71325]: DEBUG nova.network.neutron [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updating instance_info_cache with network_info: [{"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:04:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Releasing lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:04:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Instance network_info: |[{"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:04:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aaf6bebd-1a75-422d-b380-c5bf63d51de6 req-b2cf1a59-80dd-494e-9a30-acae9bddceab service nova] Acquired lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:04:07 user nova-compute[71325]: DEBUG nova.network.neutron [req-aaf6bebd-1a75-422d-b380-c5bf63d51de6 req-b2cf1a59-80dd-494e-9a30-acae9bddceab service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Refreshing network info cache for port 9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:04:07 user nova-compute[71325]: DEBUG nova.network.neutron [req-aaf6bebd-1a75-422d-b380-c5bf63d51de6 req-b2cf1a59-80dd-494e-9a30-acae9bddceab service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updated VIF entry in instance network info cache for port 9bbf8f11-4979-445b-b429-c2b404283afc. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:04:07 user nova-compute[71325]: DEBUG nova.network.neutron [req-aaf6bebd-1a75-422d-b380-c5bf63d51de6 req-b2cf1a59-80dd-494e-9a30-acae9bddceab service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updating instance_info_cache with network_info: [{"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:04:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-aaf6bebd-1a75-422d-b380-c5bf63d51de6 req-b2cf1a59-80dd-494e-9a30-acae9bddceab service nova] Releasing lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.compute.manager [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:04:10 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Creating image(s)
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Ensure instance console log exists: /opt/stack/data/nova/instances/a70f4f57-2a18-4489-9f0d-e31e10d66fb0/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Start _get_guest_xml network_info=[{"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvFlQGDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a70f4f57-2a18-4489-9f0d-e31e10d66fb0', 'attached_at': '', 'detached_at': '', 'volume_id': '23dc11c8-0976-4037-a188-9067c88d8f0a', 'serial': '23dc11c8-0976-4037-a188-9067c88d8f0a'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'f02baae2-5f2c-432e-831d-41611008d23e', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:04:10 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:04:10 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvFlQGDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:04:10 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:04:10 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:04:10 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e68d18c-9b69-43a0-b8fe-d38b31ba0eea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:04:10 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fe9fd0-0971-4429-a801-4009aed2e84a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a] added
Apr 13 22:04:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a65887-3331-4528-9d2d-6165afb57ead]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e433b45a-ff36-4004-9adb-64207c38117e]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvFlQGDo {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvFlQGDo" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1e7717-ddfd-41f8-aa6e-9423b60d26ec]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HvFlQGDo'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dbc1e0-1a99-43ef-b05e-5929ee561e67]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c1d9a9-799e-436e-835f-e3b3c9d68c40]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:04:10 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:04:10 user nova-compute[71325]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:04:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:04:10 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:04:10 user nova-compute[71325]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:04:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[31762cc3-6477-4964-9d37-1b0c45dca850]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260]
Apr 13 22:04:10 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260] successful.
Apr 13 22:04:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[66165a6e-3baa-4583-82e6-7e4557bc3dbd]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[be90aef6-340b-4888-8e00-a28ee8109781]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:04:10 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:04:10 user nova-compute[71325]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:04:10 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:04:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:04:10 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:04:10 user nova-compute[71325]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:04:10 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:04:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1343ad50-b290-4fb2-84eb-d810de3c38eb]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:04:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvFlQGDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23637336166633531', 'path': '/dev/sdc'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637336166633531', 'path': '/dev/sdc'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1022673409',display_name='tempest-TestShelveInstance-server-1022673409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1022673409',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApLEuuj6KeDDETqj63aLVZwzI0AEs6gs5+edRAA35t7ojDda06wiLqmdjlWHC2bAnnQxBdroXp1ByYUE2HG9fvtYqO42TNErRms80pT+WCt4ra5LjATp2OXAxx0BUru0w==',key_name='tempest-TestShelveInstance-299000327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f16c57e44d2f456cab919015f4b9bb4b',ramdisk_id='',reservation_id='r-29a2f5a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1496514884',owner_user_name='tempest-TestShelveInstance-1496514884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:04:05Z,user_data=None,user_id='c8ba9f99764b4e61ac0ed632000fc672',uuid=a70f4f57-2a18-4489-9f0d-e31e10d66fb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Converting VIF {"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:2a:33,bridge_name='br-int',has_traffic_filtering=True,id=9bbf8f11-4979-445b-b429-c2b404283afc,network=Network(42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bbf8f11-49') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG nova.objects.instance [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lazy-loading 'pci_devices' on Instance uuid a70f4f57-2a18-4489-9f0d-e31e10d66fb0 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:04:11 user nova-compute[71325]:   <uuid>a70f4f57-2a18-4489-9f0d-e31e10d66fb0</uuid>
Apr 13 22:04:11 user nova-compute[71325]:   <name>instance-00000028</name>
Apr 13 22:04:11 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:04:11 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:04:11 user nova-compute[71325]:   <metadata>
Apr 13 22:04:11 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:04:11 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:04:11 user nova-compute[71325]:       <nova:name>tempest-TestShelveInstance-server-1022673409</nova:name>
Apr 13 22:04:11 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:04:10</nova:creationTime>
Apr 13 22:04:11 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:04:11 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:04:11 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:04:11 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:04:11 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:04:11 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:04:11 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:04:11 user nova-compute[71325]:       <nova:owner>
Apr 13 22:04:11 user nova-compute[71325]:         <nova:user uuid="c8ba9f99764b4e61ac0ed632000fc672">tempest-TestShelveInstance-1496514884-project-member</nova:user>
Apr 13 22:04:11 user nova-compute[71325]:         <nova:project uuid="f16c57e44d2f456cab919015f4b9bb4b">tempest-TestShelveInstance-1496514884</nova:project>
Apr 13 22:04:11 user nova-compute[71325]:       </nova:owner>
Apr 13 22:04:11 user nova-compute[71325]:       <nova:ports>
Apr 13 22:04:11 user nova-compute[71325]:         <nova:port uuid="9bbf8f11-4979-445b-b429-c2b404283afc">
Apr 13 22:04:11 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 22:04:11 user nova-compute[71325]:         </nova:port>
Apr 13 22:04:11 user nova-compute[71325]:       </nova:ports>
Apr 13 22:04:11 user nova-compute[71325]:     </nova:instance>
Apr 13 22:04:11 user nova-compute[71325]:   </metadata>
Apr 13 22:04:11 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:04:11 user nova-compute[71325]:     <system>
Apr 13 22:04:11 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:04:11 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:04:11 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:04:11 user nova-compute[71325]:       <entry name="serial">a70f4f57-2a18-4489-9f0d-e31e10d66fb0</entry>
Apr 13 22:04:11 user nova-compute[71325]:       <entry name="uuid">a70f4f57-2a18-4489-9f0d-e31e10d66fb0</entry>
Apr 13 22:04:11 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:04:11 user nova-compute[71325]:     </system>
Apr 13 22:04:11 user nova-compute[71325]:   </sysinfo>
Apr 13 22:04:11 user nova-compute[71325]:   <os>
Apr 13 22:04:11 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:04:11 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:04:11 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:04:11 user nova-compute[71325]:   </os>
Apr 13 22:04:11 user nova-compute[71325]:   <features>
Apr 13 22:04:11 user nova-compute[71325]:     <acpi/>
Apr 13 22:04:11 user nova-compute[71325]:     <apic/>
Apr 13 22:04:11 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:04:11 user nova-compute[71325]:   </features>
Apr 13 22:04:11 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:04:11 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:04:11 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:04:11 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:04:11 user nova-compute[71325]:   </clock>
Apr 13 22:04:11 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:04:11 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:04:11 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:04:11 user nova-compute[71325]:   </cpu>
Apr 13 22:04:11 user nova-compute[71325]:   <devices>
Apr 13 22:04:11 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 22:04:11 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:04:11 user nova-compute[71325]:       <source dev="/dev/sdc"/>
Apr 13 22:04:11 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:04:11 user nova-compute[71325]:       <serial>23dc11c8-0976-4037-a188-9067c88d8f0a</serial>
Apr 13 22:04:11 user nova-compute[71325]:     </disk>
Apr 13 22:04:11 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:04:11 user nova-compute[71325]:       <mac address="fa:16:3e:37:2a:33"/>
Apr 13 22:04:11 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:04:11 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:04:11 user nova-compute[71325]:       <target dev="tap9bbf8f11-49"/>
Apr 13 22:04:11 user nova-compute[71325]:     </interface>
Apr 13 22:04:11 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:04:11 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/a70f4f57-2a18-4489-9f0d-e31e10d66fb0/console.log" append="off"/>
Apr 13 22:04:11 user nova-compute[71325]:     </serial>
Apr 13 22:04:11 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:04:11 user nova-compute[71325]:     <video>
Apr 13 22:04:11 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:04:11 user nova-compute[71325]:     </video>
Apr 13 22:04:11 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:04:11 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:04:11 user nova-compute[71325]:     </rng>
Apr 13 22:04:11 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:04:11 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:04:11 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:04:11 user nova-compute[71325]:     </memballoon>
Apr 13 22:04:11 user nova-compute[71325]:   </devices>
Apr 13 22:04:11 user nova-compute[71325]: </domain>
Apr 13 22:04:11 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1022673409',display_name='tempest-TestShelveInstance-server-1022673409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1022673409',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApLEuuj6KeDDETqj63aLVZwzI0AEs6gs5+edRAA35t7ojDda06wiLqmdjlWHC2bAnnQxBdroXp1ByYUE2HG9fvtYqO42TNErRms80pT+WCt4ra5LjATp2OXAxx0BUru0w==',key_name='tempest-TestShelveInstance-299000327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f16c57e44d2f456cab919015f4b9bb4b',ramdisk_id='',reservation_id='r-29a2f5a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1496514884',owner_user_name='tempest-TestShelveInstance-1496514884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:04:05Z,user_data=None,user_id='c8ba9f99764b4e61ac0ed632000fc672',uuid=a70f4f57-2a18-4489-9f0d-e31e10d66fb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Converting VIF {"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:2a:33,bridge_name='br-int',has_traffic_filtering=True,id=9bbf8f11-4979-445b-b429-c2b404283afc,network=Network(42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bbf8f11-49') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG os_vif [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:2a:33,bridge_name='br-int',has_traffic_filtering=True,id=9bbf8f11-4979-445b-b429-c2b404283afc,network=Network(42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bbf8f11-49') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bbf8f11-49, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9bbf8f11-49, col_values=(('external_ids', {'iface-id': '9bbf8f11-4979-445b-b429-c2b404283afc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:2a:33', 'vm-uuid': 'a70f4f57-2a18-4489-9f0d-e31e10d66fb0'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:04:11 user nova-compute[71325]: INFO os_vif [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:2a:33,bridge_name='br-int',has_traffic_filtering=True,id=9bbf8f11-4979-445b-b429-c2b404283afc,network=Network(42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bbf8f11-49')
Apr 13 22:04:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:04:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] No VIF found with MAC fa:16:3e:37:2a:33, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:04:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:13 user nova-compute[71325]: DEBUG nova.compute.manager [req-68abb4d8-8a77-4bc4-a2d1-4d9135e09877 req-8fb264c4-6f9f-4426-a3fd-683342208bf1 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-68abb4d8-8a77-4bc4-a2d1-4d9135e09877 req-8fb264c4-6f9f-4426-a3fd-683342208bf1 service nova] Acquiring lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-68abb4d8-8a77-4bc4-a2d1-4d9135e09877 req-8fb264c4-6f9f-4426-a3fd-683342208bf1 service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:13 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-68abb4d8-8a77-4bc4-a2d1-4d9135e09877 req-8fb264c4-6f9f-4426-a3fd-683342208bf1 service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:13 user nova-compute[71325]: DEBUG nova.compute.manager [req-68abb4d8-8a77-4bc4-a2d1-4d9135e09877 req-8fb264c4-6f9f-4426-a3fd-683342208bf1 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] No waiting events found dispatching network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:04:13 user nova-compute[71325]: WARNING nova.compute.manager [req-68abb4d8-8a77-4bc4-a2d1-4d9135e09877 req-8fb264c4-6f9f-4426-a3fd-683342208bf1 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received unexpected event network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc for instance with vm_state building and task_state spawning.
Apr 13 22:04:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:14 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423455.2286918, a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:04:15 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] VM Resumed (Lifecycle Event)
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:04:15 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Instance spawned successfully.
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:15 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423455.2299423, a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:04:15 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] VM Started (Lifecycle Event)
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:04:15 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:04:15 user nova-compute[71325]: INFO nova.compute.manager [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Took 5.13 seconds to spawn the instance on the hypervisor.
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:15 user nova-compute[71325]: INFO nova.compute.manager [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Took 10.92 seconds to build instance.
Apr 13 22:04:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.015s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-b386e4f1-b571-457c-863c-934d96e2589c req-814375bc-95d2-473f-b75e-9e2b4e86250d service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b386e4f1-b571-457c-863c-934d96e2589c req-814375bc-95d2-473f-b75e-9e2b4e86250d service nova] Acquiring lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b386e4f1-b571-457c-863c-934d96e2589c req-814375bc-95d2-473f-b75e-9e2b4e86250d service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-b386e4f1-b571-457c-863c-934d96e2589c req-814375bc-95d2-473f-b75e-9e2b4e86250d service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-b386e4f1-b571-457c-863c-934d96e2589c req-814375bc-95d2-473f-b75e-9e2b4e86250d service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] No waiting events found dispatching network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:04:15 user nova-compute[71325]: WARNING nova.compute.manager [req-b386e4f1-b571-457c-863c-934d96e2589c req-814375bc-95d2-473f-b75e-9e2b4e86250d service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received unexpected event network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc for instance with vm_state active and task_state None.
Apr 13 22:04:16 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:04:16 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:04:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:16 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Didn't find any instances for network info cache update. {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 22:04:16 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:04:17 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:04:17 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:04:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:04:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:18 user nova-compute[71325]: INFO nova.compute.manager [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Unrescuing
Apr 13 22:04:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "refresh_cache-e874e1c2-9dd4-4ca5-b273-abd35526d921" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquired lock "refresh_cache-e874e1c2-9dd4-4ca5-b273-abd35526d921" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:18 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Updating instance_info_cache with network_info: [{"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Releasing lock "refresh_cache-e874e1c2-9dd4-4ca5-b273-abd35526d921" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'flavor' on Instance uuid e874e1c2-9dd4-4ca5-b273-abd35526d921 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-362c4df6-0799-469e-b913-9cd4e090eda7 req-bfbeec6f-e006-4078-8268-f89ed0a2f962 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-unplugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-362c4df6-0799-469e-b913-9cd4e090eda7 req-bfbeec6f-e006-4078-8268-f89ed0a2f962 service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-362c4df6-0799-469e-b913-9cd4e090eda7 req-bfbeec6f-e006-4078-8268-f89ed0a2f962 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-362c4df6-0799-469e-b913-9cd4e090eda7 req-bfbeec6f-e006-4078-8268-f89ed0a2f962 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-362c4df6-0799-469e-b913-9cd4e090eda7 req-bfbeec6f-e006-4078-8268-f89ed0a2f962 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-unplugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:04:19 user nova-compute[71325]: WARNING nova.compute.manager [req-362c4df6-0799-469e-b913-9cd4e090eda7 req-bfbeec6f-e006-4078-8268-f89ed0a2f962 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-unplugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state rescued and task_state unrescuing.
Apr 13 22:04:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:04:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:19 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Instance destroyed successfully.
Apr 13 22:04:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/disk.rescue --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:20 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:04:20 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:04:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7704MB free_disk=25.925315856933594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance bfcfa307-25f3-43e0-837b-704b5cd7783f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance e874e1c2-9dd4-4ca5-b273-abd35526d921 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ada4ed22-c00b-47cd-885b-58d7eceff652 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance e568023a-3163-428f-8b1a-6c854c65f46f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:04:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:04:21 user nova-compute[71325]: WARNING nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state rescued and task_state unrescuing.
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:04:21 user nova-compute[71325]: WARNING nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state rescued and task_state unrescuing.
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:04:21 user nova-compute[71325]: WARNING nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state rescued and task_state unrescuing.
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-unplugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-unplugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:04:21 user nova-compute[71325]: WARNING nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-unplugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state rescued and task_state unrescuing.
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:04:21 user nova-compute[71325]: WARNING nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state rescued and task_state unrescuing.
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:04:21 user nova-compute[71325]: WARNING nova.compute.manager [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state rescued and task_state unrescuing.
Apr 13 22:04:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for e874e1c2-9dd4-4ca5-b273-abd35526d921 due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 22:04:23 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423463.287912, e874e1c2-9dd4-4ca5-b273-abd35526d921 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:04:23 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] VM Resumed (Lifecycle Event)
Apr 13 22:04:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:04:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:04:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:04:23 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 22:04:23 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423463.2891405, e874e1c2-9dd4-4ca5-b273-abd35526d921 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:04:23 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] VM Started (Lifecycle Event)
Apr 13 22:04:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:04:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:04:23 user nova-compute[71325]: DEBUG nova.compute.manager [req-9f015367-1ad9-409a-821b-4c1dd463dac8 req-a46b0e43-0637-4f90-a6d5-c934c7768e7c service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9f015367-1ad9-409a-821b-4c1dd463dac8 req-a46b0e43-0637-4f90-a6d5-c934c7768e7c service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9f015367-1ad9-409a-821b-4c1dd463dac8 req-a46b0e43-0637-4f90-a6d5-c934c7768e7c service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9f015367-1ad9-409a-821b-4c1dd463dac8 req-a46b0e43-0637-4f90-a6d5-c934c7768e7c service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:23 user nova-compute[71325]: DEBUG nova.compute.manager [req-9f015367-1ad9-409a-821b-4c1dd463dac8 req-a46b0e43-0637-4f90-a6d5-c934c7768e7c service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:04:23 user nova-compute[71325]: WARNING nova.compute.manager [req-9f015367-1ad9-409a-821b-4c1dd463dac8 req-a46b0e43-0637-4f90-a6d5-c934c7768e7c service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state active and task_state None.
Apr 13 22:04:24 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:04:24 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:04:24 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:04:24 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:04:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:26 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:04:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-61744840-3ccf-4c64-b903-e5e7310a5acd req-72e916a0-dc7b-4556-b0de-8b818c6a8aa2 service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Received event network-changed-832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-61744840-3ccf-4c64-b903-e5e7310a5acd req-72e916a0-dc7b-4556-b0de-8b818c6a8aa2 service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Refreshing instance network info cache due to event network-changed-832e1c7c-c4ab-4265-8173-6aa27ed74a1e. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:04:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-61744840-3ccf-4c64-b903-e5e7310a5acd req-72e916a0-dc7b-4556-b0de-8b818c6a8aa2 service nova] Acquiring lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:04:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-61744840-3ccf-4c64-b903-e5e7310a5acd req-72e916a0-dc7b-4556-b0de-8b818c6a8aa2 service nova] Acquired lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:04:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-61744840-3ccf-4c64-b903-e5e7310a5acd req-72e916a0-dc7b-4556-b0de-8b818c6a8aa2 service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Refreshing network info cache for port 832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:04:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-61744840-3ccf-4c64-b903-e5e7310a5acd req-72e916a0-dc7b-4556-b0de-8b818c6a8aa2 service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Updated VIF entry in instance network info cache for port 832e1c7c-c4ab-4265-8173-6aa27ed74a1e. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:04:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-61744840-3ccf-4c64-b903-e5e7310a5acd req-72e916a0-dc7b-4556-b0de-8b818c6a8aa2 service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Updating instance_info_cache with network_info: [{"id": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "address": "fa:16:3e:98:81:ee", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832e1c7c-c4", "ovs_interfaceid": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:04:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-61744840-3ccf-4c64-b903-e5e7310a5acd req-72e916a0-dc7b-4556-b0de-8b818c6a8aa2 service nova] Releasing lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:04:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "03027926-4eef-4af8-afca-b70f625de6ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "03027926-4eef-4af8-afca-b70f625de6ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:04:42 user nova-compute[71325]: INFO nova.compute.claims [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Claim successful on node user
Apr 13 22:04:42 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:04:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:04:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:04:42 user nova-compute[71325]: INFO nova.virt.block_device [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Booting with volume f7e87d6a-37e1-4284-90fb-23b6b89ad772 at /dev/vda
Apr 13 22:04:42 user nova-compute[71325]: DEBUG nova.policy [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG os_brick.utils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6563b1fa-9ab5-4149-8e30-b48ce2a08c96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[03146a45-07d2-4a0d-9e3f-36eea3f1c686]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[459b0a99-9b60-4603-981c-0bdeb051aa6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cfe6fc-2adc-4945-af95-69176d2543c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:04:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:04:43 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:04:43 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4786b500-c008-4fb8-906e-44ab1fbe17cf]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:04:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:04:43 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:04:43 user nova-compute[71325]: DEBUG os_brick.utils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:04:43 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updating existing volume attachment record: f2ba380e-a269-4dc1-8df9-4cd29b0d407e {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:04:43 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Successfully created port: c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:04:44 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Successfully updated port: c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:04:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:04:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquired lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:04:44 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:04:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-e89742a2-d012-4e95-9e61-7aab90e53e66 req-0edce251-f4ab-438d-a998-e6248180996e service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received event network-changed-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-e89742a2-d012-4e95-9e61-7aab90e53e66 req-0edce251-f4ab-438d-a998-e6248180996e service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Refreshing instance network info cache due to event network-changed-c519a061-16fb-426a-ba45-ff2fa6d655cd. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:04:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e89742a2-d012-4e95-9e61-7aab90e53e66 req-0edce251-f4ab-438d-a998-e6248180996e service nova] Acquiring lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:04:44 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:04:44 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updating instance_info_cache with network_info: [{"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:04:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Releasing lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:04:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Instance network_info: |[{"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:04:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e89742a2-d012-4e95-9e61-7aab90e53e66 req-0edce251-f4ab-438d-a998-e6248180996e service nova] Acquired lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:04:44 user nova-compute[71325]: DEBUG nova.network.neutron [req-e89742a2-d012-4e95-9e61-7aab90e53e66 req-0edce251-f4ab-438d-a998-e6248180996e service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Refreshing network info cache for port c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:04:45 user nova-compute[71325]: DEBUG nova.network.neutron [req-e89742a2-d012-4e95-9e61-7aab90e53e66 req-0edce251-f4ab-438d-a998-e6248180996e service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updated VIF entry in instance network info cache for port c519a061-16fb-426a-ba45-ff2fa6d655cd. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:04:45 user nova-compute[71325]: DEBUG nova.network.neutron [req-e89742a2-d012-4e95-9e61-7aab90e53e66 req-0edce251-f4ab-438d-a998-e6248180996e service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updating instance_info_cache with network_info: [{"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:04:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e89742a2-d012-4e95-9e61-7aab90e53e66 req-0edce251-f4ab-438d-a998-e6248180996e service nova] Releasing lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:04:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:04:47 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Creating image(s)
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Ensure instance console log exists: /opt/stack/data/nova/instances/03027926-4eef-4af8-afca-b70f625de6ab/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Start _get_guest_xml network_info=[{"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JiZrxcnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '03027926-4eef-4af8-afca-b70f625de6ab', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7e87d6a-37e1-4284-90fb-23b6b89ad772', 'serial': 'f7e87d6a-37e1-4284-90fb-23b6b89ad772'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'f2ba380e-a269-4dc1-8df9-4cd29b0d407e', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:04:47 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:04:47 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JiZrxcnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:04:47 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:04:47 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:04:47 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43d46c3-4364-4152-8fcb-ff1845afa1e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:04:47 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9e993f-5161-4380-820e-eaee5207ceef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772] added
Apr 13 22:04:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[484fa5da-51fc-43bf-9804-ae21c9165807]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deea216-07cd-455d-8fb8-3dc7246a710d]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JiZrxcnv {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JiZrxcnv" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a18717d-8dbf-45ac-9eda-bb75d6da1298]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JiZrxcnv'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[807e766f-7d60-46bd-a5ae-3bc177694bcc]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fbd4ea-bbb7-4eab-966a-f0620d9c8eb8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:04:47 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:04:47 user nova-compute[71325]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:04:47 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:04:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:04:47 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:04:47 user nova-compute[71325]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:04:47 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:04:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d263c59f-ad4a-4427-b2a9-2f5686b88216]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260]
Apr 13 22:04:47 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260] successful.
Apr 13 22:04:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce781d71-17e7-42df-8aff-672b14aaa9a6]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e73ef5-3b71-44f1-b3b0-dda0a1ba3701]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:04:47 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:04:47 user nova-compute[71325]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:04:47 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:04:47 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:04:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:04:47 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:04:47 user nova-compute[71325]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:04:47 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:04:47 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:04:47 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c088d27b-6b45-485f-b6b0-5e384b904356]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:04:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JiZrxcnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23932653439343566', 'path': '/dev/sde'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932653439343566', 'path': '/dev/sde'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1601106766',display_name='tempest-ServerActionsTestJSON-server-1601106766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1601106766',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-r3zpb3tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:04:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=03027926-4eef-4af8-afca-b70f625de6ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ce:28,bridge_name='br-int',has_traffic_filtering=True,id=c519a061-16fb-426a-ba45-ff2fa6d655cd,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc519a061-16') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'pci_devices' on Instance uuid 03027926-4eef-4af8-afca-b70f625de6ab {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:04:48 user nova-compute[71325]:   <uuid>03027926-4eef-4af8-afca-b70f625de6ab</uuid>
Apr 13 22:04:48 user nova-compute[71325]:   <name>instance-00000029</name>
Apr 13 22:04:48 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:04:48 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:04:48 user nova-compute[71325]:   <metadata>
Apr 13 22:04:48 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:04:48 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:04:48 user nova-compute[71325]:       <nova:name>tempest-ServerActionsTestJSON-server-1601106766</nova:name>
Apr 13 22:04:48 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:04:47</nova:creationTime>
Apr 13 22:04:48 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:04:48 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:04:48 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:04:48 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:04:48 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:04:48 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:04:48 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:04:48 user nova-compute[71325]:       <nova:owner>
Apr 13 22:04:48 user nova-compute[71325]:         <nova:user uuid="b3db8b01a05b43f68bfd8695253514db">tempest-ServerActionsTestJSON-236976022-project-member</nova:user>
Apr 13 22:04:48 user nova-compute[71325]:         <nova:project uuid="7c086cffbafb4da68f172ab27da232d3">tempest-ServerActionsTestJSON-236976022</nova:project>
Apr 13 22:04:48 user nova-compute[71325]:       </nova:owner>
Apr 13 22:04:48 user nova-compute[71325]:       <nova:ports>
Apr 13 22:04:48 user nova-compute[71325]:         <nova:port uuid="c519a061-16fb-426a-ba45-ff2fa6d655cd">
Apr 13 22:04:48 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 22:04:48 user nova-compute[71325]:         </nova:port>
Apr 13 22:04:48 user nova-compute[71325]:       </nova:ports>
Apr 13 22:04:48 user nova-compute[71325]:     </nova:instance>
Apr 13 22:04:48 user nova-compute[71325]:   </metadata>
Apr 13 22:04:48 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:04:48 user nova-compute[71325]:     <system>
Apr 13 22:04:48 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:04:48 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:04:48 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:04:48 user nova-compute[71325]:       <entry name="serial">03027926-4eef-4af8-afca-b70f625de6ab</entry>
Apr 13 22:04:48 user nova-compute[71325]:       <entry name="uuid">03027926-4eef-4af8-afca-b70f625de6ab</entry>
Apr 13 22:04:48 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:04:48 user nova-compute[71325]:     </system>
Apr 13 22:04:48 user nova-compute[71325]:   </sysinfo>
Apr 13 22:04:48 user nova-compute[71325]:   <os>
Apr 13 22:04:48 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:04:48 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:04:48 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:04:48 user nova-compute[71325]:   </os>
Apr 13 22:04:48 user nova-compute[71325]:   <features>
Apr 13 22:04:48 user nova-compute[71325]:     <acpi/>
Apr 13 22:04:48 user nova-compute[71325]:     <apic/>
Apr 13 22:04:48 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:04:48 user nova-compute[71325]:   </features>
Apr 13 22:04:48 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:04:48 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:04:48 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:04:48 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:04:48 user nova-compute[71325]:   </clock>
Apr 13 22:04:48 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:04:48 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:04:48 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:04:48 user nova-compute[71325]:   </cpu>
Apr 13 22:04:48 user nova-compute[71325]:   <devices>
Apr 13 22:04:48 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 22:04:48 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:04:48 user nova-compute[71325]:       <source dev="/dev/sde"/>
Apr 13 22:04:48 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:04:48 user nova-compute[71325]:       <serial>f7e87d6a-37e1-4284-90fb-23b6b89ad772</serial>
Apr 13 22:04:48 user nova-compute[71325]:     </disk>
Apr 13 22:04:48 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:04:48 user nova-compute[71325]:       <mac address="fa:16:3e:23:ce:28"/>
Apr 13 22:04:48 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:04:48 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:04:48 user nova-compute[71325]:       <target dev="tapc519a061-16"/>
Apr 13 22:04:48 user nova-compute[71325]:     </interface>
Apr 13 22:04:48 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:04:48 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/03027926-4eef-4af8-afca-b70f625de6ab/console.log" append="off"/>
Apr 13 22:04:48 user nova-compute[71325]:     </serial>
Apr 13 22:04:48 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:04:48 user nova-compute[71325]:     <video>
Apr 13 22:04:48 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:04:48 user nova-compute[71325]:     </video>
Apr 13 22:04:48 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:04:48 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:04:48 user nova-compute[71325]:     </rng>
Apr 13 22:04:48 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:04:48 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:04:48 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:04:48 user nova-compute[71325]:     </memballoon>
Apr 13 22:04:48 user nova-compute[71325]:   </devices>
Apr 13 22:04:48 user nova-compute[71325]: </domain>
Apr 13 22:04:48 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1601106766',display_name='tempest-ServerActionsTestJSON-server-1601106766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1601106766',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-r3zpb3tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:04:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=03027926-4eef-4af8-afca-b70f625de6ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ce:28,bridge_name='br-int',has_traffic_filtering=True,id=c519a061-16fb-426a-ba45-ff2fa6d655cd,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc519a061-16') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG os_vif [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ce:28,bridge_name='br-int',has_traffic_filtering=True,id=c519a061-16fb-426a-ba45-ff2fa6d655cd,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc519a061-16') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc519a061-16, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc519a061-16, col_values=(('external_ids', {'iface-id': 'c519a061-16fb-426a-ba45-ff2fa6d655cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:ce:28', 'vm-uuid': '03027926-4eef-4af8-afca-b70f625de6ab'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:04:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:48 user nova-compute[71325]: INFO os_vif [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ce:28,bridge_name='br-int',has_traffic_filtering=True,id=c519a061-16fb-426a-ba45-ff2fa6d655cd,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc519a061-16')
Apr 13 22:04:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:04:49 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No VIF found with MAC fa:16:3e:23:ce:28, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:04:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:50 user nova-compute[71325]: DEBUG nova.compute.manager [req-f4353de9-1383-4c02-954b-2f89506ccfbb req-d8e172d4-b071-4e89-bb94-a71268b9db9d service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received event network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f4353de9-1383-4c02-954b-2f89506ccfbb req-d8e172d4-b071-4e89-bb94-a71268b9db9d service nova] Acquiring lock "03027926-4eef-4af8-afca-b70f625de6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f4353de9-1383-4c02-954b-2f89506ccfbb req-d8e172d4-b071-4e89-bb94-a71268b9db9d service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f4353de9-1383-4c02-954b-2f89506ccfbb req-d8e172d4-b071-4e89-bb94-a71268b9db9d service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:50 user nova-compute[71325]: DEBUG nova.compute.manager [req-f4353de9-1383-4c02-954b-2f89506ccfbb req-d8e172d4-b071-4e89-bb94-a71268b9db9d service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] No waiting events found dispatching network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:04:50 user nova-compute[71325]: WARNING nova.compute.manager [req-f4353de9-1383-4c02-954b-2f89506ccfbb req-d8e172d4-b071-4e89-bb94-a71268b9db9d service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received unexpected event network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd for instance with vm_state building and task_state spawning.
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423492.403282, 03027926-4eef-4af8-afca-b70f625de6ab => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:04:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] VM Resumed (Lifecycle Event)
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:04:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Instance spawned successfully.
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:04:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423492.4044793, 03027926-4eef-4af8-afca-b70f625de6ab => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:04:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] VM Started (Lifecycle Event)
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:04:52 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:04:52 user nova-compute[71325]: INFO nova.compute.manager [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Took 5.00 seconds to spawn the instance on the hypervisor.
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-32ba00d4-80f0-4957-9a85-789ea8caa5d7 req-b02fa8f4-aa78-4994-bd4e-7f440301d737 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received event network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-32ba00d4-80f0-4957-9a85-789ea8caa5d7 req-b02fa8f4-aa78-4994-bd4e-7f440301d737 service nova] Acquiring lock "03027926-4eef-4af8-afca-b70f625de6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-32ba00d4-80f0-4957-9a85-789ea8caa5d7 req-b02fa8f4-aa78-4994-bd4e-7f440301d737 service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-32ba00d4-80f0-4957-9a85-789ea8caa5d7 req-b02fa8f4-aa78-4994-bd4e-7f440301d737 service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-32ba00d4-80f0-4957-9a85-789ea8caa5d7 req-b02fa8f4-aa78-4994-bd4e-7f440301d737 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] No waiting events found dispatching network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:04:52 user nova-compute[71325]: WARNING nova.compute.manager [req-32ba00d4-80f0-4957-9a85-789ea8caa5d7 req-b02fa8f4-aa78-4994-bd4e-7f440301d737 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received unexpected event network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd for instance with vm_state building and task_state spawning.
Apr 13 22:04:52 user nova-compute[71325]: INFO nova.compute.manager [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Took 10.43 seconds to build instance.
Apr 13 22:04:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "03027926-4eef-4af8-afca-b70f625de6ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.527s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:04:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:04:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:14 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:05:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:17 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:05:17 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:05:17 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:05:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:05:17 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:05:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:05:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:05:20 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:05:20 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=7638MB free_disk=25.92123794555664GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance bfcfa307-25f3-43e0-837b-704b5cd7783f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance e874e1c2-9dd4-4ca5-b273-abd35526d921 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ada4ed22-c00b-47cd-885b-58d7eceff652 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance e568023a-3163-428f-8b1a-6c854c65f46f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 03027926-4eef-4af8-afca-b70f625de6ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:05:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.510s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:05:21 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:05:21 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:05:21 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:05:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:05:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:05:21 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:05:21 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lazy-loading 'info_cache' on Instance uuid b5ce77dc-eda4-4b96-8d61-2297d986f3ee {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:05:22 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Updating instance_info_cache with network_info: [{"id": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "address": "fa:16:3e:c3:11:10", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922fdd9d-6e", "ovs_interfaceid": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:05:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-b5ce77dc-eda4-4b96-8d61-2297d986f3ee" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:05:22 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:05:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:05:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:05:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:24 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:05:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:26 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:05:26 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:05:28 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:05:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:05:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:05:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:05:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:05:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-28583af5-30d3-4254-8c45-58b6fd6801e3 req-c9aca8c8-c63d-4fb1-be1f-e974331da464 service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Received event network-changed-71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-28583af5-30d3-4254-8c45-58b6fd6801e3 req-c9aca8c8-c63d-4fb1-be1f-e974331da464 service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Refreshing instance network info cache due to event network-changed-71388612-8dc7-4935-b3d2-489e3d4b171e. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-28583af5-30d3-4254-8c45-58b6fd6801e3 req-c9aca8c8-c63d-4fb1-be1f-e974331da464 service nova] Acquiring lock "refresh_cache-fc6cc27b-3d35-44e3-97dd-aac5a596d21c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-28583af5-30d3-4254-8c45-58b6fd6801e3 req-c9aca8c8-c63d-4fb1-be1f-e974331da464 service nova] Acquired lock "refresh_cache-fc6cc27b-3d35-44e3-97dd-aac5a596d21c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-28583af5-30d3-4254-8c45-58b6fd6801e3 req-c9aca8c8-c63d-4fb1-be1f-e974331da464 service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Refreshing network info cache for port 71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:05:36 user nova-compute[71325]: INFO nova.compute.manager [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Terminating instance
Apr 13 22:05:36 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-28583af5-30d3-4254-8c45-58b6fd6801e3 req-c9aca8c8-c63d-4fb1-be1f-e974331da464 service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Updated VIF entry in instance network info cache for port 71388612-8dc7-4935-b3d2-489e3d4b171e. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-28583af5-30d3-4254-8c45-58b6fd6801e3 req-c9aca8c8-c63d-4fb1-be1f-e974331da464 service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Updating instance_info_cache with network_info: [{"id": "71388612-8dc7-4935-b3d2-489e3d4b171e", "address": "fa:16:3e:52:d6:82", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71388612-8d", "ovs_interfaceid": "71388612-8dc7-4935-b3d2-489e3d4b171e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:05:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-28583af5-30d3-4254-8c45-58b6fd6801e3 req-c9aca8c8-c63d-4fb1-be1f-e974331da464 service nova] Releasing lock "refresh_cache-fc6cc27b-3d35-44e3-97dd-aac5a596d21c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:05:37 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Instance destroyed successfully.
Apr 13 22:05:37 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lazy-loading 'resources' on Instance uuid fc6cc27b-3d35-44e3-97dd-aac5a596d21c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1352949408',display_name='tempest-TestVolumeBootPattern-server-1352949408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1352949408',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORfhunB7LA94/Vo0IeX5uHg0BK3ZrJIdCSr/QNts93zg201FlS6UuD5bquQQY3opSX8Ui/7/1jLECj4NoRXCObFsyJekLp1y4HjowC79e9IEN0rtSp6qQ2huNvtbuOLUg==',key_name='tempest-TestVolumeBootPattern-949568181',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:03:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-3tx1ccv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:03:56Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=fc6cc27b-3d35-44e3-97dd-aac5a596d21c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71388612-8dc7-4935-b3d2-489e3d4b171e", "address": "fa:16:3e:52:d6:82", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71388612-8d", "ovs_interfaceid": "71388612-8dc7-4935-b3d2-489e3d4b171e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "71388612-8dc7-4935-b3d2-489e3d4b171e", "address": "fa:16:3e:52:d6:82", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71388612-8d", "ovs_interfaceid": "71388612-8dc7-4935-b3d2-489e3d4b171e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:d6:82,bridge_name='br-int',has_traffic_filtering=True,id=71388612-8dc7-4935-b3d2-489e3d4b171e,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71388612-8d') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_vif [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:d6:82,bridge_name='br-int',has_traffic_filtering=True,id=71388612-8dc7-4935-b3d2-489e3d4b171e,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71388612-8d') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71388612-8d, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:37 user nova-compute[71325]: INFO os_vif [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:d6:82,bridge_name='br-int',has_traffic_filtering=True,id=71388612-8dc7-4935-b3d2-489e3d4b171e,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71388612-8d')
Apr 13 22:05:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHjyYtwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:05:37 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[443b7088-3254-4d25-b258-89aff294f073]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:05:37 user nova-compute[71325]: No targets found.
Apr 13 22:05:37 user nova-compute[71325]: iSNS:
Apr 13 22:05:37 user nova-compute[71325]: No targets found.
Apr 13 22:05:37 user nova-compute[71325]: STATIC:
Apr 13 22:05:37 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f
Apr 13 22:05:37 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:37 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:37 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a
Apr 13 22:05:37 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:37 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:37 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903
Apr 13 22:05:37 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:37 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:37 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 22:05:37 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:37 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:37 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772
Apr 13 22:05:37 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:37 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:37 user nova-compute[71325]: FIRMWARE:
Apr 13 22:05:37 user nova-compute[71325]: No targets found.
Apr 13 22:05:37 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:05:37 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:05:37 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[15586f21-73ee-4426-bc30-6f753463f841]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8e2881-4f38-47dc-8e0e-f5bc0a5ca7b3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:37 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:37 user nova-compute[71325]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:05:37 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:05:37 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:37 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:37 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:37 user nova-compute[71325]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:05:37 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:05:37 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:37 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c4694670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ba4a7f-5e6c-484f-a402-6ecb3ae7a993]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a0b21c-1607-4022-8140-e17602c88570]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e20171-b54e-4494-a787-e60893e9e1a8]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f40346-2895-469c-aa75-39df9f1c52fa]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc7f537fc-140d8e1cbc427487', '/dev/disk/by-id/scsi-23134306438653163', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c7f537fc') {{(pid=82476) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 22:05:37 user nova-compute[71325]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOc7f537fc-140d8e1cbc427487
Apr 13 22:05:37 user nova-compute[71325]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23134306438653163
Apr 13 22:05:37 user nova-compute[71325]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_c7f537fc
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[86472e00-ff81-4573-9729-5dec5b8bee3d]: (4, None) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c8443f-0f5b-4f92-b30c-eefcdec1cf99]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47902cd-918f-47f4-8316-616442832d2f]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260]
Apr 13 22:05:37 user nova-compute[71325]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260] successful.
Apr 13 22:05:37 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[87271b95-5d68-45cf-a40f-5b642890befb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== disconnect_volume: return (316ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:05:37 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Deleting instance files /opt/stack/data/nova/instances/fc6cc27b-3d35-44e3-97dd-aac5a596d21c_del
Apr 13 22:05:37 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Deletion of /opt/stack/data/nova/instances/fc6cc27b-3d35-44e3-97dd-aac5a596d21c_del complete
Apr 13 22:05:37 user nova-compute[71325]: INFO nova.compute.manager [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 13 22:05:37 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:05:37 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:05:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Received event network-vif-unplugged-71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:05:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] Acquiring lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] Lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] Lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:05:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] No waiting events found dispatching network-vif-unplugged-71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:05:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Received event network-vif-unplugged-71388612-8dc7-4935-b3d2-489e3d4b171e for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:05:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Received event network-vif-plugged-71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:05:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] Acquiring lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] Lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] Lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:05:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] No waiting events found dispatching network-vif-plugged-71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:05:38 user nova-compute[71325]: WARNING nova.compute.manager [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Received unexpected event network-vif-plugged-71388612-8dc7-4935-b3d2-489e3d4b171e for instance with vm_state active and task_state deleting.
Apr 13 22:05:39 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:05:39 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Took 1.39 seconds to deallocate network for instance.
Apr 13 22:05:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-3d2eed83-8a34-48c9-8a53-2b6f384a44e6 req-5af0c6e3-9aac-4f25-9da5-4467795c8d3d service nova] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Received event network-vif-deleted-71388612-8dc7-4935-b3d2-489e3d4b171e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:05:39 user nova-compute[71325]: INFO nova.compute.manager [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Took 0.77 seconds to detach 1 volumes for instance.
Apr 13 22:05:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:40 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:05:40 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:05:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:05:40 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Deleted allocations for instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c
Apr 13 22:05:40 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "fc6cc27b-3d35-44e3-97dd-aac5a596d21c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.836s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:05:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-c9b24579-39fe-4e07-a8b1-055c02f8f5f0 req-240b77e4-1caa-4167-9dad-809458481e2d service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Received event network-changed-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-c9b24579-39fe-4e07-a8b1-055c02f8f5f0 req-240b77e4-1caa-4167-9dad-809458481e2d service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Refreshing instance network info cache due to event network-changed-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c9b24579-39fe-4e07-a8b1-055c02f8f5f0 req-240b77e4-1caa-4167-9dad-809458481e2d service nova] Acquiring lock "refresh_cache-940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c9b24579-39fe-4e07-a8b1-055c02f8f5f0 req-240b77e4-1caa-4167-9dad-809458481e2d service nova] Acquired lock "refresh_cache-940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG nova.network.neutron [req-c9b24579-39fe-4e07-a8b1-055c02f8f5f0 req-240b77e4-1caa-4167-9dad-809458481e2d service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Refreshing network info cache for port 2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG nova.objects.instance [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lazy-loading 'flavor' on Instance uuid 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:41 user nova-compute[71325]: INFO nova.compute.manager [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Attaching volume 23417134-71af-40e5-82a3-c491a40aee89 to /dev/vdb
Apr 13 22:05:41 user nova-compute[71325]: DEBUG nova.network.neutron [req-c9b24579-39fe-4e07-a8b1-055c02f8f5f0 req-240b77e4-1caa-4167-9dad-809458481e2d service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Updated VIF entry in instance network info cache for port 2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG nova.network.neutron [req-c9b24579-39fe-4e07-a8b1-055c02f8f5f0 req-240b77e4-1caa-4167-9dad-809458481e2d service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Updating instance_info_cache with network_info: [{"id": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "address": "fa:16:3e:a8:57:54", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee4b50e-d2", "ovs_interfaceid": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c9b24579-39fe-4e07-a8b1-055c02f8f5f0 req-240b77e4-1caa-4167-9dad-809458481e2d service nova] Releasing lock "refresh_cache-940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG os_brick.utils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dae4c79-4687-4e97-9313-61d4c3007f93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[111434a5-a454-4dd1-b4b3-4b8125612c40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d68a69-5020-4451-bb53-8b7557faf35c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31eda59-e295-4811-8250-ace53b626276]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:41 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:05:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:05:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:05:42 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:05:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e4b2c5-9bb3-4363-8f2b-075289d54f87]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:05:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:05:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:05:42 user nova-compute[71325]: DEBUG os_brick.utils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:05:42 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Updating existing volume attachment record: ef754843-378a-476e-b5d8-e3d880dd719c {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:05:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzyGQPNk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:05:46 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:05:46 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:05:46 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[69626b57-9603-4f83-802e-f847c9ff389c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:05:46 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba9c62d-b721-432b-86dd-034deeff1a0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89] added
Apr 13 22:05:46 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9a15e3-b7e9-47f9-bfa7-2ae63bf1dc35]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[049df110-4f32-47f9-abfb-49682a06f4fa]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xzyGQPNk {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xzyGQPNk" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4587e2b-719f-449a-8074-63223f37d119]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xzyGQPNk'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[698a31d9-bf44-479f-8eb0-8c20a9d95c60]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70edd7b-20c1-43f2-acf5-ac598df6e841]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:46 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:46 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:05:46 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:46 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:46 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:46 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:05:46 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:46 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee35928f-dd16-4581-9929-baaf3d903826]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89, portal: 172.16.0.220,3260]
Apr 13 22:05:46 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89, portal: 172.16.0.220,3260] successful.
Apr 13 22:05:46 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c63361-ad5e-431d-aec1-1d602821f7bb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[40380f1a-af12-4679-9e94-46b7d0b0e9da]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:46 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:46 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:05:46 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:46 user nova-compute[71325]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 (non-flash)
Apr 13 22:05:46 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:46 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:46 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:05:46 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:46 user nova-compute[71325]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 (non-flash)
Apr 13 22:05:46 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87c4224-fdcc-4dc0-9130-d41c34a8f857]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:05:46 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzyGQPNk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:05:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:05:47 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23063336664303039', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:05:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063336664303039', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:05:47 user nova-compute[71325]: DEBUG nova.objects.instance [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lazy-loading 'flavor' on Instance uuid 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:05:47 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:05:47 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:05:47 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:05:47 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:05:47 user nova-compute[71325]:   <serial>23417134-71af-40e5-82a3-c491a40aee89</serial>
Apr 13 22:05:47 user nova-compute[71325]: </disk>
Apr 13 22:05:47 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:05:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:05:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:05:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] No VIF found with MAC fa:16:3e:a8:57:54, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:05:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.551s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:05:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-58f3590e-fbd1-4da3-a94b-b88ae09c0ed7 req-b2664d74-a71e-420c-9adb-cde6240fb814 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Received event network-changed-45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:05:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-58f3590e-fbd1-4da3-a94b-b88ae09c0ed7 req-b2664d74-a71e-420c-9adb-cde6240fb814 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Refreshing instance network info cache due to event network-changed-45ea22f6-3663-4d12-a479-41c56f1e9bc2. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:05:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-58f3590e-fbd1-4da3-a94b-b88ae09c0ed7 req-b2664d74-a71e-420c-9adb-cde6240fb814 service nova] Acquiring lock "refresh_cache-e568023a-3163-428f-8b1a-6c854c65f46f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:05:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-58f3590e-fbd1-4da3-a94b-b88ae09c0ed7 req-b2664d74-a71e-420c-9adb-cde6240fb814 service nova] Acquired lock "refresh_cache-e568023a-3163-428f-8b1a-6c854c65f46f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:05:49 user nova-compute[71325]: DEBUG nova.network.neutron [req-58f3590e-fbd1-4da3-a94b-b88ae09c0ed7 req-b2664d74-a71e-420c-9adb-cde6240fb814 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Refreshing network info cache for port 45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:05:49 user nova-compute[71325]: DEBUG nova.network.neutron [req-58f3590e-fbd1-4da3-a94b-b88ae09c0ed7 req-b2664d74-a71e-420c-9adb-cde6240fb814 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Updated VIF entry in instance network info cache for port 45ea22f6-3663-4d12-a479-41c56f1e9bc2. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:05:49 user nova-compute[71325]: DEBUG nova.network.neutron [req-58f3590e-fbd1-4da3-a94b-b88ae09c0ed7 req-b2664d74-a71e-420c-9adb-cde6240fb814 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Updating instance_info_cache with network_info: [{"id": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "address": "fa:16:3e:9e:73:66", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ea22f6-36", "ovs_interfaceid": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:05:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-58f3590e-fbd1-4da3-a94b-b88ae09c0ed7 req-b2664d74-a71e-420c-9adb-cde6240fb814 service nova] Releasing lock "refresh_cache-e568023a-3163-428f-8b1a-6c854c65f46f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:50 user nova-compute[71325]: INFO nova.compute.manager [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Detaching volume 23417134-71af-40e5-82a3-c491a40aee89
Apr 13 22:05:50 user nova-compute[71325]: INFO nova.virt.block_device [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Attempting to driver detach volume 23417134-71af-40e5-82a3-c491a40aee89 from mountpoint /dev/vdb
Apr 13 22:05:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Attempting to detach device vdb from instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:05:50 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:05:50 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:05:50 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:05:50 user nova-compute[71325]:   <serial>23417134-71af-40e5-82a3-c491a40aee89</serial>
Apr 13 22:05:50 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:05:50 user nova-compute[71325]: </disk>
Apr 13 22:05:50 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:05:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Successfully detached device vdb from instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 from the persistent domain config.
Apr 13 22:05:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:05:50 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:05:50 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:05:50 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:05:50 user nova-compute[71325]:   <serial>23417134-71af-40e5-82a3-c491a40aee89</serial>
Apr 13 22:05:50 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:05:50 user nova-compute[71325]: </disk>
Apr 13 22:05:50 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681423550.7333064, 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:05:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Successfully detached device vdb from instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 from the live domain config.
Apr 13 22:05:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzyGQPNk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:05:50 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eeeb5a-54d8-4bff-8495-bf39949818d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:05:50 user nova-compute[71325]: No targets found.
Apr 13 22:05:50 user nova-compute[71325]: iSNS:
Apr 13 22:05:50 user nova-compute[71325]: No targets found.
Apr 13 22:05:50 user nova-compute[71325]: STATIC:
Apr 13 22:05:50 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a
Apr 13 22:05:50 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:50 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:50 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903
Apr 13 22:05:50 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:50 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:50 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 22:05:50 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:50 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:50 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89
Apr 13 22:05:50 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:50 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:50 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772
Apr 13 22:05:50 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:50 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:50 user nova-compute[71325]: FIRMWARE:
Apr 13 22:05:50 user nova-compute[71325]: No targets found.
Apr 13 22:05:50 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:05:50 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:05:50 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cc51c3-63f1-46b4-8270-94a958503cb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a5c60c-bad4-4a79-a595-d7bf6ca69de0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:50 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:50 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:05:50 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:50 user nova-compute[71325]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 (non-flash)
Apr 13 22:05:50 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:50 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:50 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:05:50 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:50 user nova-compute[71325]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 (non-flash)
Apr 13 22:05:50 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c4697f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39b33ff-a494-451f-924e-6305a9536406]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39a9b0f-74ec-4f10-bc6e-50042d24a2d7]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d942a2-5d08-45a3-b431-d66f413a496d]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1388583-659f-4c51-b1f6-37e6fda26009]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f5f299-7c0f-499f-bbb2-c9d4aa46b4f4]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:50 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1fe5db-993d-4a05-870f-6b6cb9c5639a]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89, portal: 172.16.0.220,3260]
Apr 13 22:05:51 user nova-compute[71325]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89, portal: 172.16.0.220,3260] successful.
Apr 13 22:05:51 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "e568023a-3163-428f-8b1a-6c854c65f46f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "e568023a-3163-428f-8b1a-6c854c65f46f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23417134-71af-40e5-82a3-c491a40aee89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[62820283-399c-4c55-a1af-5a0bc8049175]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] <== disconnect_volume: return (319ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG nova.objects.instance [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'flavor' on Instance uuid e568023a-3163-428f-8b1a-6c854c65f46f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "e568023a-3163-428f-8b1a-6c854c65f46f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "e568023a-3163-428f-8b1a-6c854c65f46f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "e568023a-3163-428f-8b1a-6c854c65f46f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:51 user nova-compute[71325]: INFO nova.compute.manager [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Attaching volume f91dcd15-83a3-443c-a8b1-7952554a2b6e to /dev/vdb
Apr 13 22:05:51 user nova-compute[71325]: DEBUG os_brick.utils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c92ab36-61e2-4fab-959e-31420f603671]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c2a890-93ae-4ec4-aaba-4be3d33f7b05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[beec2b69-4eeb-4da4-a2a4-de37f668ddea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8203b77-9825-4462-a047-50cd2583b60a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:05:51 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[614ec110-7bfe-4bba-8716-ec2e21824ec3]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG os_brick.utils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Updating existing volume attachment record: 9032ec3b-ec28-411c-a39b-af73cd248242 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG nova.objects.instance [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lazy-loading 'flavor' on Instance uuid 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:05:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:05:52 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423537.317638, fc6cc27b-3d35-44e3-97dd-aac5a596d21c => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:05:52 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] VM Stopped (Lifecycle Event)
Apr 13 22:05:52 user nova-compute[71325]: DEBUG nova.compute.manager [None req-88dfcaf2-6960-4266-82a1-a9ba5ecf6ff0 None None] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:05:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzwIRPEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:05:55 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:05:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:05:55 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:05:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:05:55 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70389c9-5a96-40fe-a622-bdc98166b142]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:05:55 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cee1ed-7da7-4e7b-a674-6639e560a34f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e] added
Apr 13 22:05:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e4b9bb-9615-43a5-b025-64b5f68a3c9c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9024c235-daeb-4cc5-ba3e-450bae134188]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZzwIRPEL {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZzwIRPEL" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f7758f-d505-4232-ab3b-3964921976cd]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZzwIRPEL'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[449848e0-8359-4bd1-ab1c-113ab7e04240]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f6f524-6983-4ae2-8ade-a193480f2ce1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:55 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:55 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:05:55 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:55 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:55 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:05:55 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:05:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3410bd4f-9e99-45d0-9f6d-64ae6cb36927]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e, portal: 172.16.0.220,3260]
Apr 13 22:05:56 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e, portal: 172.16.0.220,3260] successful.
Apr 13 22:05:56 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c06f94-d956-428b-bd01-935a51a11520]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b192e18c-bf54-4936-b3de-c202f3f724f0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:56 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:56 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:05:56 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:56 user nova-compute[71325]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e (non-flash)
Apr 13 22:05:56 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:56 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:56 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:05:56 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:56 user nova-compute[71325]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e (non-flash)
Apr 13 22:05:56 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dc3c22-5e9d-437e-9961-cdd52922071e]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:56 user nova-compute[71325]: INFO nova.compute.manager [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Shelve offloading
Apr 13 22:05:56 user nova-compute[71325]: DEBUG nova.compute.manager [req-872de4b1-78f1-4e38-b458-941ff327ddbd req-8865171c-30a2-4161-876c-cb1260a349c0 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-changed-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG nova.compute.manager [req-872de4b1-78f1-4e38-b458-941ff327ddbd req-8865171c-30a2-4161-876c-cb1260a349c0 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Refreshing instance network info cache due to event network-changed-9bbf8f11-4979-445b-b429-c2b404283afc. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-872de4b1-78f1-4e38-b458-941ff327ddbd req-8865171c-30a2-4161-876c-cb1260a349c0 service nova] Acquiring lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-872de4b1-78f1-4e38-b458-941ff327ddbd req-8865171c-30a2-4161-876c-cb1260a349c0 service nova] Acquired lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG nova.network.neutron [req-872de4b1-78f1-4e38-b458-941ff327ddbd req-8865171c-30a2-4161-876c-cb1260a349c0 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Refreshing network info cache for port 9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG nova.compute.manager [req-31fc6e59-6fbf-4584-a181-fffb778b9a3c req-5bafa573-e06c-4520-877e-60d206d95e3c service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-vif-unplugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-31fc6e59-6fbf-4584-a181-fffb778b9a3c req-5bafa573-e06c-4520-877e-60d206d95e3c service nova] Acquiring lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-31fc6e59-6fbf-4584-a181-fffb778b9a3c req-5bafa573-e06c-4520-877e-60d206d95e3c service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-31fc6e59-6fbf-4584-a181-fffb778b9a3c req-5bafa573-e06c-4520-877e-60d206d95e3c service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:05:56 user nova-compute[71325]: DEBUG nova.compute.manager [req-31fc6e59-6fbf-4584-a181-fffb778b9a3c req-5bafa573-e06c-4520-877e-60d206d95e3c service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] No waiting events found dispatching network-vif-unplugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:05:56 user nova-compute[71325]: WARNING nova.compute.manager [req-31fc6e59-6fbf-4584-a181-fffb778b9a3c req-5bafa573-e06c-4520-877e-60d206d95e3c service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received unexpected event network-vif-unplugged-9bbf8f11-4979-445b-b429-c2b404283afc for instance with vm_state active and task_state shelving.
Apr 13 22:05:57 user nova-compute[71325]: DEBUG nova.network.neutron [req-872de4b1-78f1-4e38-b458-941ff327ddbd req-8865171c-30a2-4161-876c-cb1260a349c0 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updated VIF entry in instance network info cache for port 9bbf8f11-4979-445b-b429-c2b404283afc. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG nova.network.neutron [req-872de4b1-78f1-4e38-b458-941ff327ddbd req-8865171c-30a2-4161-876c-cb1260a349c0 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updating instance_info_cache with network_info: [{"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzwIRPEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23234396262336232', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234396262336232', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG nova.objects.instance [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'flavor' on Instance uuid e568023a-3163-428f-8b1a-6c854c65f46f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-872de4b1-78f1-4e38-b458-941ff327ddbd req-8865171c-30a2-4161-876c-cb1260a349c0 service nova] Releasing lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:05:57 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:05:57 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:05:57 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:05:57 user nova-compute[71325]:   <serial>f91dcd15-83a3-443c-a8b1-7952554a2b6e</serial>
Apr 13 22:05:57 user nova-compute[71325]: </disk>
Apr 13 22:05:57 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:57 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Instance destroyed successfully.
Apr 13 22:05:57 user nova-compute[71325]: DEBUG nova.compute.manager [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquired lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG nova.network.neutron [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] No VIF found with MAC fa:16:3e:9e:73:66, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:05:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "e568023a-3163-428f-8b1a-6c854c65f46f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.544s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG nova.network.neutron [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updating instance_info_cache with network_info: [{"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Releasing lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:05:58 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Instance destroyed successfully.
Apr 13 22:05:58 user nova-compute[71325]: DEBUG nova.objects.instance [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lazy-loading 'resources' on Instance uuid a70f4f57-2a18-4489-9f0d-e31e10d66fb0 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1022673409',display_name='tempest-TestShelveInstance-server-1022673409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1022673409',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApLEuuj6KeDDETqj63aLVZwzI0AEs6gs5+edRAA35t7ojDda06wiLqmdjlWHC2bAnnQxBdroXp1ByYUE2HG9fvtYqO42TNErRms80pT+WCt4ra5LjATp2OXAxx0BUru0w==',key_name='tempest-TestShelveInstance-299000327',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f16c57e44d2f456cab919015f4b9bb4b',ramdisk_id='',reservation_id='r-29a2f5a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1496514884',owner_user_name='tempest-TestShelveInstance-1496514884-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:04:15Z,user_data=None,user_id='c8ba9f99764b4e61ac0ed632000fc672',uuid=a70f4f57-2a18-4489-9f0d-e31e10d66fb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Converting VIF {"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:2a:33,bridge_name='br-int',has_traffic_filtering=True,id=9bbf8f11-4979-445b-b429-c2b404283afc,network=Network(42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bbf8f11-49') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG os_vif [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:2a:33,bridge_name='br-int',has_traffic_filtering=True,id=9bbf8f11-4979-445b-b429-c2b404283afc,network=Network(42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bbf8f11-49') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bbf8f11-49, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-32827517-3f13-45f1-ae30-cebcd26a0c6f req-39dffb0a-8113-442f-9cbf-b5db6fe16e9c service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-changed-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-32827517-3f13-45f1-ae30-cebcd26a0c6f req-39dffb0a-8113-442f-9cbf-b5db6fe16e9c service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Refreshing instance network info cache due to event network-changed-9bbf8f11-4979-445b-b429-c2b404283afc. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-32827517-3f13-45f1-ae30-cebcd26a0c6f req-39dffb0a-8113-442f-9cbf-b5db6fe16e9c service nova] Acquiring lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-32827517-3f13-45f1-ae30-cebcd26a0c6f req-39dffb0a-8113-442f-9cbf-b5db6fe16e9c service nova] Acquired lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG nova.network.neutron [req-32827517-3f13-45f1-ae30-cebcd26a0c6f req-39dffb0a-8113-442f-9cbf-b5db6fe16e9c service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Refreshing network info cache for port 9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:05:58 user nova-compute[71325]: INFO os_vif [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:2a:33,bridge_name='br-int',has_traffic_filtering=True,id=9bbf8f11-4979-445b-b429-c2b404283afc,network=Network(42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bbf8f11-49')
Apr 13 22:05:58 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvFlQGDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:05:58 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:05:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[705f1f75-0e8e-4eab-8fb8-b7f8e89a1999]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:05:58 user nova-compute[71325]: No targets found.
Apr 13 22:05:58 user nova-compute[71325]: iSNS:
Apr 13 22:05:58 user nova-compute[71325]: No targets found.
Apr 13 22:05:58 user nova-compute[71325]: STATIC:
Apr 13 22:05:58 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e
Apr 13 22:05:58 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:58 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:58 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a
Apr 13 22:05:58 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:58 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:58 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903
Apr 13 22:05:58 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:58 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:58 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 22:05:58 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:58 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:58 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772
Apr 13 22:05:58 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:58 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:58 user nova-compute[71325]: FIRMWARE:
Apr 13 22:05:58 user nova-compute[71325]: No targets found.
Apr 13 22:05:58 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:05:58 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:05:58 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-71e89cfe-f4a2-445e-b06f-dd0e3dd3e9fe req-66aaa2fb-8d8a-4280-8673-3779ee17565f service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-71e89cfe-f4a2-445e-b06f-dd0e3dd3e9fe req-66aaa2fb-8d8a-4280-8673-3779ee17565f service nova] Acquiring lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-71e89cfe-f4a2-445e-b06f-dd0e3dd3e9fe req-66aaa2fb-8d8a-4280-8673-3779ee17565f service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-71e89cfe-f4a2-445e-b06f-dd0e3dd3e9fe req-66aaa2fb-8d8a-4280-8673-3779ee17565f service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-71e89cfe-f4a2-445e-b06f-dd0e3dd3e9fe req-66aaa2fb-8d8a-4280-8673-3779ee17565f service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] No waiting events found dispatching network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:05:58 user nova-compute[71325]: WARNING nova.compute.manager [req-71e89cfe-f4a2-445e-b06f-dd0e3dd3e9fe req-66aaa2fb-8d8a-4280-8673-3779ee17565f service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received unexpected event network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc for instance with vm_state active and task_state shelving.
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7873eb1-1cac-4a27-b502-a4faa470e9db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d223245e-6fc2-42ba-b1c4-6f8c248caec2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:58 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:58 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:05:58 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:58 user nova-compute[71325]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e (non-flash)
Apr 13 22:05:58 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:58 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:58 user nova-compute[71325]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:05:58 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:58 user nova-compute[71325]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e (non-flash)
Apr 13 22:05:58 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5a41b6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a'): ({'sdc'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Removing single pathed devices sdc {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:05:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0328582-7cc1-4e9d-a021-cb3b7ca1bd99]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eef01c9-3fd3-4058-a4ab-c32c036e2ecb]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Flushing IO for device /dev/sdc {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb53cd4b-dee1-4566-a44d-fce7af0c2954]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[214fdeff-4a73-4a81-bf28-168bbfb54a26]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e7aa72-e26c-4438-9a3f-833d8dc9097f]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "e568023a-3163-428f-8b1a-6c854c65f46f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "e568023a-3163-428f-8b1a-6c854c65f46f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1e4378-3320-43bb-a764-00becefeaed4]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260]
Apr 13 22:05:59 user nova-compute[71325]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260] successful.
Apr 13 22:05:59 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:59 user nova-compute[71325]: INFO nova.compute.manager [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Detaching volume f91dcd15-83a3-443c-a8b1-7952554a2b6e
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba38313d-08eb-48af-9c12-639523fda100]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] <== disconnect_volume: return (338ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:05:59 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Deleting instance files /opt/stack/data/nova/instances/a70f4f57-2a18-4489-9f0d-e31e10d66fb0_del
Apr 13 22:05:59 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Deletion of /opt/stack/data/nova/instances/a70f4f57-2a18-4489-9f0d-e31e10d66fb0_del complete
Apr 13 22:05:59 user nova-compute[71325]: INFO nova.virt.block_device [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Attempting to driver detach volume f91dcd15-83a3-443c-a8b1-7952554a2b6e from mountpoint /dev/vdb
Apr 13 22:05:59 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Attempting to detach device vdb from instance e568023a-3163-428f-8b1a-6c854c65f46f from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:05:59 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:05:59 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:05:59 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:05:59 user nova-compute[71325]:   <serial>f91dcd15-83a3-443c-a8b1-7952554a2b6e</serial>
Apr 13 22:05:59 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:05:59 user nova-compute[71325]: </disk>
Apr 13 22:05:59 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:05:59 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Successfully detached device vdb from instance e568023a-3163-428f-8b1a-6c854c65f46f from the persistent domain config.
Apr 13 22:05:59 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e568023a-3163-428f-8b1a-6c854c65f46f from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:05:59 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:05:59 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:05:59 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:05:59 user nova-compute[71325]:   <serial>f91dcd15-83a3-443c-a8b1-7952554a2b6e</serial>
Apr 13 22:05:59 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:05:59 user nova-compute[71325]: </disk>
Apr 13 22:05:59 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG nova.network.neutron [req-32827517-3f13-45f1-ae30-cebcd26a0c6f req-39dffb0a-8113-442f-9cbf-b5db6fe16e9c service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updated VIF entry in instance network info cache for port 9bbf8f11-4979-445b-b429-c2b404283afc. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG nova.network.neutron [req-32827517-3f13-45f1-ae30-cebcd26a0c6f req-39dffb0a-8113-442f-9cbf-b5db6fe16e9c service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updating instance_info_cache with network_info: [{"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": null, "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-32827517-3f13-45f1-ae30-cebcd26a0c6f req-39dffb0a-8113-442f-9cbf-b5db6fe16e9c service nova] Releasing lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681423559.791435, e568023a-3163-428f-8b1a-6c854c65f46f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e568023a-3163-428f-8b1a-6c854c65f46f {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:05:59 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Successfully detached device vdb from instance e568023a-3163-428f-8b1a-6c854c65f46f from the live domain config.
Apr 13 22:05:59 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzwIRPEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:05:59 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e06a4a9-8f5a-4e3f-af41-5b3d02df6d76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:05:59 user nova-compute[71325]: No targets found.
Apr 13 22:05:59 user nova-compute[71325]: iSNS:
Apr 13 22:05:59 user nova-compute[71325]: No targets found.
Apr 13 22:05:59 user nova-compute[71325]: STATIC:
Apr 13 22:05:59 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e
Apr 13 22:05:59 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:59 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:59 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903
Apr 13 22:05:59 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:59 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:59 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 22:05:59 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:59 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:59 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772
Apr 13 22:05:59 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:05:59 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:05:59 user nova-compute[71325]: FIRMWARE:
Apr 13 22:05:59 user nova-compute[71325]: No targets found.
Apr 13 22:05:59 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:05:59 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:05:59 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3335ca8-d0cc-45fa-859e-c671536d7ef1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[db28747d-8550-43ad-b14e-a4d8e3211e7b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:59 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:59 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:59 user nova-compute[71325]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e (non-flash)
Apr 13 22:05:59 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:05:59 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:05:59 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:05:59 user nova-compute[71325]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e (non-flash)
Apr 13 22:05:59 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c4695090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5a832c-bdc1-4ed2-8a9e-17bb6d4fb5b8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e389f93e-4a32-407e-9d2f-3633dfe2a377]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9b3dba-1d9a-4f41-816d-2d06096eff61]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c46a7b3-8588-4168-9828-ca0319a0da24]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:05:59 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[82479767-cb60-426c-a946-41f03f58fa47]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56ff77f-69db-4b36-b3de-ac2e98b04279]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e, portal: 172.16.0.220,3260]
Apr 13 22:06:00 user nova-compute[71325]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e, portal: 172.16.0.220,3260] successful.
Apr 13 22:06:00 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91dcd15-83a3-443c-a8b1-7952554a2b6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[930ed17e-f48f-43dc-9249-ed36c7e2f22b]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] <== disconnect_volume: return (310ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:06:00 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Deleted allocations for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0
Apr 13 22:06:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG nova.objects.instance [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lazy-loading 'numa_topology' on Instance uuid a70f4f57-2a18-4489-9f0d-e31e10d66fb0 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.177s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG nova.objects.instance [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'flavor' on Instance uuid e568023a-3163-428f-8b1a-6c854c65f46f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:06:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "e568023a-3163-428f-8b1a-6c854c65f46f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.739s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:09 user nova-compute[71325]: INFO nova.compute.manager [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Terminating instance
Apr 13 22:06:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG nova.compute.manager [req-3d6d7b71-fbbf-4c92-b511-8236aa761e1f req-5af23410-b0c0-4f8f-8cb4-eba98976b1ff service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-unplugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3d6d7b71-fbbf-4c92-b511-8236aa761e1f req-5af23410-b0c0-4f8f-8cb4-eba98976b1ff service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3d6d7b71-fbbf-4c92-b511-8236aa761e1f req-5af23410-b0c0-4f8f-8cb4-eba98976b1ff service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3d6d7b71-fbbf-4c92-b511-8236aa761e1f req-5af23410-b0c0-4f8f-8cb4-eba98976b1ff service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG nova.compute.manager [req-3d6d7b71-fbbf-4c92-b511-8236aa761e1f req-5af23410-b0c0-4f8f-8cb4-eba98976b1ff service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-unplugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG nova.compute.manager [req-3d6d7b71-fbbf-4c92-b511-8236aa761e1f req-5af23410-b0c0-4f8f-8cb4-eba98976b1ff service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-unplugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:10 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Instance destroyed successfully.
Apr 13 22:06:10 user nova-compute[71325]: DEBUG nova.objects.instance [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'resources' on Instance uuid e874e1c2-9dd4-4ca5-b273-abd35526d921 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-596484231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-596484231',id=34,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:02:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11a30fba887e4114be856d26b47a8e55',ramdisk_id='',reservation_id='r-qe9g0iq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-33854562',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:04:23Z,user_data=None,user_id='0ab740920cac4befac62a72f7ce5a817',uuid=e874e1c2-9dd4-4ca5-b273-abd35526d921,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converting VIF {"id": "0b935ba6-4632-4032-8efd-bdb45a707797", "address": "fa:16:3e:d8:58:5f", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b935ba6-46", "ovs_interfaceid": "0b935ba6-4632-4032-8efd-bdb45a707797", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:58:5f,bridge_name='br-int',has_traffic_filtering=True,id=0b935ba6-4632-4032-8efd-bdb45a707797,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b935ba6-46') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_vif [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:58:5f,bridge_name='br-int',has_traffic_filtering=True,id=0b935ba6-4632-4032-8efd-bdb45a707797,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b935ba6-46') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b935ba6-46, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:06:10 user nova-compute[71325]: INFO os_vif [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:58:5f,bridge_name='br-int',has_traffic_filtering=True,id=0b935ba6-4632-4032-8efd-bdb45a707797,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b935ba6-46')
Apr 13 22:06:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZdBmHke', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:06:10 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4f8b7b-f214-4fff-b984-edaea1c3db8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:06:10 user nova-compute[71325]: No targets found.
Apr 13 22:06:10 user nova-compute[71325]: iSNS:
Apr 13 22:06:10 user nova-compute[71325]: No targets found.
Apr 13 22:06:10 user nova-compute[71325]: STATIC:
Apr 13 22:06:10 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903
Apr 13 22:06:10 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:06:10 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:06:10 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 22:06:10 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:06:10 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:06:10 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772
Apr 13 22:06:10 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:06:10 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:06:10 user nova-compute[71325]: FIRMWARE:
Apr 13 22:06:10 user nova-compute[71325]: No targets found.
Apr 13 22:06:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:06:10 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:06:10 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2606e21c-2d00-4101-8383-7c214fce9073]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5494493-1132-4084-b82f-2a70f113f014]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:06:10 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:06:10 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:06:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:06:10 user nova-compute[71325]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 (non-flash)
Apr 13 22:06:10 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:06:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5a41b5120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903'): ({'sdf'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Removing single pathed devices sdf {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f83e965-d5db-4270-a1bd-7bfef7ddaf39]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0664c478-ee89-412d-ac43-eb7469c9081d]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flushing IO for device /dev/sdf {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee624984-a962-447c-a072-f51a326283d5]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c9b50c-bf0e-44c2-ac70-a2c104deb915]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] SCSI volumes sdf have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf109fdc6-839e210f239378ab', '/dev/disk/by-id/scsi-23833396532313066', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f109fdc6') {{(pid=82476) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56fe5f7-3d0f-4910-80eb-e7a02efc5618]: (4, None) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[047fde22-3827-41ca-9efb-09e5c4474c44]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5efab6-e07b-4588-9e9c-a0578a90582a]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903, portal: 172.16.0.220,3260]
Apr 13 22:06:10 user nova-compute[71325]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903, portal: 172.16.0.220,3260] successful.
Apr 13 22:06:10 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cbb5dd2-ad34-4b66-9716-e9dd1c04c903 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebb1cb8-14f4-4e16-b1f3-fdcfb90b7861]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] <== disconnect_volume: return (303ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:06:10 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Deleting instance files /opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921_del
Apr 13 22:06:10 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Deletion of /opt/stack/data/nova/instances/e874e1c2-9dd4-4ca5-b273-abd35526d921_del complete
Apr 13 22:06:10 user nova-compute[71325]: INFO nova.compute.manager [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Took 1.12 seconds to destroy the instance on the hypervisor.
Apr 13 22:06:10 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:10 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:06:10 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Took 0.45 seconds to deallocate network for instance.
Apr 13 22:06:11 user nova-compute[71325]: DEBUG nova.compute.manager [req-80d46621-2b74-4bf1-8bc9-2dc4fd7df372 req-6b29b5d1-8585-4b88-ad6e-a7356543384b service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-80d46621-2b74-4bf1-8bc9-2dc4fd7df372 req-6b29b5d1-8585-4b88-ad6e-a7356543384b service nova] Acquiring lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-80d46621-2b74-4bf1-8bc9-2dc4fd7df372 req-6b29b5d1-8585-4b88-ad6e-a7356543384b service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-80d46621-2b74-4bf1-8bc9-2dc4fd7df372 req-6b29b5d1-8585-4b88-ad6e-a7356543384b service nova] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:11 user nova-compute[71325]: DEBUG nova.compute.manager [req-80d46621-2b74-4bf1-8bc9-2dc4fd7df372 req-6b29b5d1-8585-4b88-ad6e-a7356543384b service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] No waiting events found dispatching network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:06:11 user nova-compute[71325]: WARNING nova.compute.manager [req-80d46621-2b74-4bf1-8bc9-2dc4fd7df372 req-6b29b5d1-8585-4b88-ad6e-a7356543384b service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received unexpected event network-vif-plugged-0b935ba6-4632-4032-8efd-bdb45a707797 for instance with vm_state active and task_state deleting.
Apr 13 22:06:11 user nova-compute[71325]: DEBUG nova.compute.manager [req-80d46621-2b74-4bf1-8bc9-2dc4fd7df372 req-6b29b5d1-8585-4b88-ad6e-a7356543384b service nova] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Received event network-vif-deleted-0b935ba6-4632-4032-8efd-bdb45a707797 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:11 user nova-compute[71325]: INFO nova.compute.manager [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Took 0.74 seconds to detach 1 volumes for instance.
Apr 13 22:06:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:11 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:06:11 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:06:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:11 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Deleted allocations for instance e874e1c2-9dd4-4ca5-b273-abd35526d921
Apr 13 22:06:12 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "e874e1c2-9dd4-4ca5-b273-abd35526d921" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.756s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:12 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423557.6057255, a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:06:12 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] VM Stopped (Lifecycle Event)
Apr 13 22:06:12 user nova-compute[71325]: DEBUG nova.compute.manager [None req-02c606c6-3a2e-4e54-91df-7003181db900 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:06:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:06:17 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:06:18 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:06:19 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:06:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:06:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:06:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:06:19 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Updating instance_info_cache with network_info: [{"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-6fbf2022-b069-440f-8513-6d107f0a7180" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:06:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:21 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:06:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:22 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:06:22 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:06:22 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8038MB free_disk=25.910930633544922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:06:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance bfcfa307-25f3-43e0-837b-704b5cd7783f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ada4ed22-c00b-47cd-885b-58d7eceff652 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance e568023a-3163-428f-8b1a-6c854c65f46f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 03027926-4eef-4af8-afca-b70f625de6ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Cleaning up deleted instances {{(pid=71325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] There are 0 instances to clean {{(pid=71325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71325) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:06:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:06:24 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:06:25 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423570.0012424, e874e1c2-9dd4-4ca5-b273-abd35526d921 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:06:25 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] VM Stopped (Lifecycle Event)
Apr 13 22:06:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6119a83b-ce71-4f8b-b747-6543859c109d None None] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:06:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:26 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:06:26 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:06:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "7741644e-2273-4d75-9b4d-8bf386400b07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "7741644e-2273-4d75-9b4d-8bf386400b07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:06:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:28 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:06:28 user nova-compute[71325]: INFO nova.compute.claims [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Claim successful on node user
Apr 13 22:06:28 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:06:28 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:06:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:06:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:06:28 user nova-compute[71325]: DEBUG nova.network.neutron [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:06:28 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:06:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:06:28 user nova-compute[71325]: INFO nova.virt.block_device [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Booting with volume 5fa56af9-4ad3-47b4-8234-7ad286b5647f at /dev/vda
Apr 13 22:06:28 user nova-compute[71325]: DEBUG nova.policy [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG os_brick.utils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcf1ada-f48c-4f87-8a82-1af523d5a893]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d96609-3bb1-4efd-a726-638b59b55cab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4599a20-d2d9-4f74-8709-f7a9b56ced08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[029642d7-2f1a-4a4e-9f06-4fc438f38a4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:06:29 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:06:29 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3f1a5c-500e-439b-a7df-b443b271ce65]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG os_brick.utils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Updating existing volume attachment record: 8541f318-40ba-4db8-b635-7982165b013c {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:06:29 user nova-compute[71325]: DEBUG nova.network.neutron [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Successfully created port: 7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG nova.network.neutron [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Successfully updated port: 7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "refresh_cache-7741644e-2273-4d75-9b4d-8bf386400b07" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquired lock "refresh_cache-7741644e-2273-4d75-9b4d-8bf386400b07" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG nova.network.neutron [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG nova.compute.manager [req-9e14ba82-6a2d-4406-a6e1-b9a17628e54f req-3db36252-bf94-47da-8009-d62709f83896 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Received event network-changed-7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG nova.compute.manager [req-9e14ba82-6a2d-4406-a6e1-b9a17628e54f req-3db36252-bf94-47da-8009-d62709f83896 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Refreshing instance network info cache due to event network-changed-7cc730c3-a97b-4fd0-8e8e-25e07a307843. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9e14ba82-6a2d-4406-a6e1-b9a17628e54f req-3db36252-bf94-47da-8009-d62709f83896 service nova] Acquiring lock "refresh_cache-7741644e-2273-4d75-9b4d-8bf386400b07" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG nova.network.neutron [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG nova.network.neutron [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Updating instance_info_cache with network_info: [{"id": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "address": "fa:16:3e:89:c8:6b", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc730c3-a9", "ovs_interfaceid": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Releasing lock "refresh_cache-7741644e-2273-4d75-9b4d-8bf386400b07" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Instance network_info: |[{"id": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "address": "fa:16:3e:89:c8:6b", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc730c3-a9", "ovs_interfaceid": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9e14ba82-6a2d-4406-a6e1-b9a17628e54f req-3db36252-bf94-47da-8009-d62709f83896 service nova] Acquired lock "refresh_cache-7741644e-2273-4d75-9b4d-8bf386400b07" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:06:30 user nova-compute[71325]: DEBUG nova.network.neutron [req-9e14ba82-6a2d-4406-a6e1-b9a17628e54f req-3db36252-bf94-47da-8009-d62709f83896 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Refreshing network info cache for port 7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:06:31 user nova-compute[71325]: DEBUG nova.network.neutron [req-9e14ba82-6a2d-4406-a6e1-b9a17628e54f req-3db36252-bf94-47da-8009-d62709f83896 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Updated VIF entry in instance network info cache for port 7cc730c3-a97b-4fd0-8e8e-25e07a307843. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:06:31 user nova-compute[71325]: DEBUG nova.network.neutron [req-9e14ba82-6a2d-4406-a6e1-b9a17628e54f req-3db36252-bf94-47da-8009-d62709f83896 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Updating instance_info_cache with network_info: [{"id": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "address": "fa:16:3e:89:c8:6b", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc730c3-a9", "ovs_interfaceid": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:06:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-9e14ba82-6a2d-4406-a6e1-b9a17628e54f req-3db36252-bf94-47da-8009-d62709f83896 service nova] Releasing lock "refresh_cache-7741644e-2273-4d75-9b4d-8bf386400b07" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:06:33 user nova-compute[71325]: DEBUG nova.compute.manager [req-2d37f6a1-da8e-4ba4-844a-f0d646ccb111 req-8c8fa303-0ac2-442c-983b-89bc1ab6b659 service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Received event network-changed-832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:33 user nova-compute[71325]: DEBUG nova.compute.manager [req-2d37f6a1-da8e-4ba4-844a-f0d646ccb111 req-8c8fa303-0ac2-442c-983b-89bc1ab6b659 service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Refreshing instance network info cache due to event network-changed-832e1c7c-c4ab-4265-8173-6aa27ed74a1e. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:06:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2d37f6a1-da8e-4ba4-844a-f0d646ccb111 req-8c8fa303-0ac2-442c-983b-89bc1ab6b659 service nova] Acquiring lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:06:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2d37f6a1-da8e-4ba4-844a-f0d646ccb111 req-8c8fa303-0ac2-442c-983b-89bc1ab6b659 service nova] Acquired lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:06:33 user nova-compute[71325]: DEBUG nova.network.neutron [req-2d37f6a1-da8e-4ba4-844a-f0d646ccb111 req-8c8fa303-0ac2-442c-983b-89bc1ab6b659 service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Refreshing network info cache for port 832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.network.neutron [req-2d37f6a1-da8e-4ba4-844a-f0d646ccb111 req-8c8fa303-0ac2-442c-983b-89bc1ab6b659 service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Updated VIF entry in instance network info cache for port 832e1c7c-c4ab-4265-8173-6aa27ed74a1e. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.network.neutron [req-2d37f6a1-da8e-4ba4-844a-f0d646ccb111 req-8c8fa303-0ac2-442c-983b-89bc1ab6b659 service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Updating instance_info_cache with network_info: [{"id": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "address": "fa:16:3e:98:81:ee", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832e1c7c-c4", "ovs_interfaceid": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2d37f6a1-da8e-4ba4-844a-f0d646ccb111 req-8c8fa303-0ac2-442c-983b-89bc1ab6b659 service nova] Releasing lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:06:34 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Creating image(s)
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Ensure instance console log exists: /opt/stack/data/nova/instances/7741644e-2273-4d75-9b4d-8bf386400b07/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Start _get_guest_xml network_info=[{"id": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "address": "fa:16:3e:89:c8:6b", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc730c3-a9", "ovs_interfaceid": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHjyYtwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7741644e-2273-4d75-9b4d-8bf386400b07', 'attached_at': '', 'detached_at': '', 'volume_id': '5fa56af9-4ad3-47b4-8234-7ad286b5647f', 'serial': '5fa56af9-4ad3-47b4-8234-7ad286b5647f'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '8541f318-40ba-4db8-b635-7982165b013c', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:06:34 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:06:34 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHjyYtwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:06:34 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:06:34 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:06:34 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad24a7c-a93f-40c5-887e-fa9695a109b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:06:34 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[23426e82-9d1e-46b1-8bed-d47753333641]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f] added
Apr 13 22:06:34 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8795035-5a02-4f41-a8c3-c11e385ac657]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8738b344-6e53-4814-bbe1-fe17ee4abdeb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHjyYtwS {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHjyYtwS" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e0ac0a-cb89-4555-8b6b-8a87da5c0f91]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AHjyYtwS'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c14b08e-b91a-421e-8e28-0bc1b45c6cc5]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dc0c9e-7615-42a9-9ad5-74233b1282e1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:06:34 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:06:34 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:06:34 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:06:34 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c5c81a-9312-4910-bed0-cacf2127907f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260]
Apr 13 22:06:34 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260] successful.
Apr 13 22:06:34 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6338f28b-8848-44ed-b8c3-11999216c87e]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8344b5a-9183-49a0-a3c6-eeacb7bffb20]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:06:34 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:06:34 user nova-compute[71325]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:06:34 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:06:34 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:06:34 user nova-compute[71325]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:06:34 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfc757a-e6b3-4130-ab58-652cdb34ae64]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Stashing vm_state: active {{(pid=71325) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'pci_requests' on Instance uuid 03027926-4eef-4af8-afca-b70f625de6ab {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:06:34 user nova-compute[71325]: INFO nova.compute.claims [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Claim successful on node user
Apr 13 22:06:34 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'resources' on Instance uuid 03027926-4eef-4af8-afca-b70f625de6ab {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'pci_devices' on Instance uuid 03027926-4eef-4af8-afca-b70f625de6ab {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:35 user nova-compute[71325]: INFO nova.compute.resource_tracker [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updating resource usage from migration 3695c41c-55d4-40e7-a150-1984d1dbd2ee
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.397s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:35 user nova-compute[71325]: INFO nova.compute.manager [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Migrating
Apr 13 22:06:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquired lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHjyYtwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23134306438653163', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134306438653163', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2080693904',display_name='tempest-TestVolumeBootPattern-server-2080693904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2080693904',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORfhunB7LA94/Vo0IeX5uHg0BK3ZrJIdCSr/QNts93zg201FlS6UuD5bquQQY3opSX8Ui/7/1jLECj4NoRXCObFsyJekLp1y4HjowC79e9IEN0rtSp6qQ2huNvtbuOLUg==',key_name='tempest-TestVolumeBootPattern-949568181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-h7d44vdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:06:29Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=7741644e-2273-4d75-9b4d-8bf386400b07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "address": "fa:16:3e:89:c8:6b", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc730c3-a9", "ovs_interfaceid": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "address": "fa:16:3e:89:c8:6b", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc730c3-a9", "ovs_interfaceid": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:c8:6b,bridge_name='br-int',has_traffic_filtering=True,id=7cc730c3-a97b-4fd0-8e8e-25e07a307843,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc730c3-a9') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.objects.instance [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lazy-loading 'pci_devices' on Instance uuid 7741644e-2273-4d75-9b4d-8bf386400b07 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:06:35 user nova-compute[71325]:   <uuid>7741644e-2273-4d75-9b4d-8bf386400b07</uuid>
Apr 13 22:06:35 user nova-compute[71325]:   <name>instance-0000002a</name>
Apr 13 22:06:35 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:06:35 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:06:35 user nova-compute[71325]:   <metadata>
Apr 13 22:06:35 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:06:35 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:06:35 user nova-compute[71325]:       <nova:name>tempest-TestVolumeBootPattern-server-2080693904</nova:name>
Apr 13 22:06:35 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:06:34</nova:creationTime>
Apr 13 22:06:35 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:06:35 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:06:35 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:06:35 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:06:35 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:06:35 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:06:35 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:06:35 user nova-compute[71325]:       <nova:owner>
Apr 13 22:06:35 user nova-compute[71325]:         <nova:user uuid="50a8a5f433c94e0c9ba4d6ecea37d756">tempest-TestVolumeBootPattern-1335483698-project-member</nova:user>
Apr 13 22:06:35 user nova-compute[71325]:         <nova:project uuid="ad824150d99044c6ab1c7829cbe01de5">tempest-TestVolumeBootPattern-1335483698</nova:project>
Apr 13 22:06:35 user nova-compute[71325]:       </nova:owner>
Apr 13 22:06:35 user nova-compute[71325]:       <nova:ports>
Apr 13 22:06:35 user nova-compute[71325]:         <nova:port uuid="7cc730c3-a97b-4fd0-8e8e-25e07a307843">
Apr 13 22:06:35 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 22:06:35 user nova-compute[71325]:         </nova:port>
Apr 13 22:06:35 user nova-compute[71325]:       </nova:ports>
Apr 13 22:06:35 user nova-compute[71325]:     </nova:instance>
Apr 13 22:06:35 user nova-compute[71325]:   </metadata>
Apr 13 22:06:35 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:06:35 user nova-compute[71325]:     <system>
Apr 13 22:06:35 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:06:35 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:06:35 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:06:35 user nova-compute[71325]:       <entry name="serial">7741644e-2273-4d75-9b4d-8bf386400b07</entry>
Apr 13 22:06:35 user nova-compute[71325]:       <entry name="uuid">7741644e-2273-4d75-9b4d-8bf386400b07</entry>
Apr 13 22:06:35 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:06:35 user nova-compute[71325]:     </system>
Apr 13 22:06:35 user nova-compute[71325]:   </sysinfo>
Apr 13 22:06:35 user nova-compute[71325]:   <os>
Apr 13 22:06:35 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:06:35 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:06:35 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:06:35 user nova-compute[71325]:   </os>
Apr 13 22:06:35 user nova-compute[71325]:   <features>
Apr 13 22:06:35 user nova-compute[71325]:     <acpi/>
Apr 13 22:06:35 user nova-compute[71325]:     <apic/>
Apr 13 22:06:35 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:06:35 user nova-compute[71325]:   </features>
Apr 13 22:06:35 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:06:35 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:06:35 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:06:35 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:06:35 user nova-compute[71325]:   </clock>
Apr 13 22:06:35 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:06:35 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:06:35 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:06:35 user nova-compute[71325]:   </cpu>
Apr 13 22:06:35 user nova-compute[71325]:   <devices>
Apr 13 22:06:35 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 22:06:35 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:06:35 user nova-compute[71325]:       <source dev="/dev/sdb"/>
Apr 13 22:06:35 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:06:35 user nova-compute[71325]:       <serial>5fa56af9-4ad3-47b4-8234-7ad286b5647f</serial>
Apr 13 22:06:35 user nova-compute[71325]:     </disk>
Apr 13 22:06:35 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:06:35 user nova-compute[71325]:       <mac address="fa:16:3e:89:c8:6b"/>
Apr 13 22:06:35 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:06:35 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:06:35 user nova-compute[71325]:       <target dev="tap7cc730c3-a9"/>
Apr 13 22:06:35 user nova-compute[71325]:     </interface>
Apr 13 22:06:35 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:06:35 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/7741644e-2273-4d75-9b4d-8bf386400b07/console.log" append="off"/>
Apr 13 22:06:35 user nova-compute[71325]:     </serial>
Apr 13 22:06:35 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:06:35 user nova-compute[71325]:     <video>
Apr 13 22:06:35 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:06:35 user nova-compute[71325]:     </video>
Apr 13 22:06:35 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:06:35 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:06:35 user nova-compute[71325]:     </rng>
Apr 13 22:06:35 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:06:35 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:06:35 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:06:35 user nova-compute[71325]:     </memballoon>
Apr 13 22:06:35 user nova-compute[71325]:   </devices>
Apr 13 22:06:35 user nova-compute[71325]: </domain>
Apr 13 22:06:35 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2080693904',display_name='tempest-TestVolumeBootPattern-server-2080693904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2080693904',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORfhunB7LA94/Vo0IeX5uHg0BK3ZrJIdCSr/QNts93zg201FlS6UuD5bquQQY3opSX8Ui/7/1jLECj4NoRXCObFsyJekLp1y4HjowC79e9IEN0rtSp6qQ2huNvtbuOLUg==',key_name='tempest-TestVolumeBootPattern-949568181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-h7d44vdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:06:29Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=7741644e-2273-4d75-9b4d-8bf386400b07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "address": "fa:16:3e:89:c8:6b", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc730c3-a9", "ovs_interfaceid": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "address": "fa:16:3e:89:c8:6b", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc730c3-a9", "ovs_interfaceid": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:c8:6b,bridge_name='br-int',has_traffic_filtering=True,id=7cc730c3-a97b-4fd0-8e8e-25e07a307843,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc730c3-a9') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG os_vif [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:c8:6b,bridge_name='br-int',has_traffic_filtering=True,id=7cc730c3-a97b-4fd0-8e8e-25e07a307843,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc730c3-a9') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cc730c3-a9, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7cc730c3-a9, col_values=(('external_ids', {'iface-id': '7cc730c3-a97b-4fd0-8e8e-25e07a307843', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:c8:6b', 'vm-uuid': '7741644e-2273-4d75-9b4d-8bf386400b07'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:35 user nova-compute[71325]: INFO os_vif [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:c8:6b,bridge_name='br-int',has_traffic_filtering=True,id=7cc730c3-a97b-4fd0-8e8e-25e07a307843,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc730c3-a9')
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] No VIF found with MAC fa:16:3e:89:c8:6b, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.compute.manager [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received event network-changed-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.compute.manager [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Refreshing instance network info cache due to event network-changed-c519a061-16fb-426a-ba45-ff2fa6d655cd. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] Acquiring lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updating instance_info_cache with network_info: [{"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Releasing lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] Acquired lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.network.neutron [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Refreshing network info cache for port c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:06:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Starting migrate_disk_and_power_off {{(pid=71325) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 13 22:06:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-8c4fcf82-54f3-4a30-8a87-cbb710191bdb req-fce15cc2-3575-4a64-b148-30e41a264640 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received event network-vif-unplugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8c4fcf82-54f3-4a30-8a87-cbb710191bdb req-fce15cc2-3575-4a64-b148-30e41a264640 service nova] Acquiring lock "03027926-4eef-4af8-afca-b70f625de6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8c4fcf82-54f3-4a30-8a87-cbb710191bdb req-fce15cc2-3575-4a64-b148-30e41a264640 service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8c4fcf82-54f3-4a30-8a87-cbb710191bdb req-fce15cc2-3575-4a64-b148-30e41a264640 service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:36 user nova-compute[71325]: DEBUG nova.compute.manager [req-8c4fcf82-54f3-4a30-8a87-cbb710191bdb req-fce15cc2-3575-4a64-b148-30e41a264640 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] No waiting events found dispatching network-vif-unplugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:06:36 user nova-compute[71325]: WARNING nova.compute.manager [req-8c4fcf82-54f3-4a30-8a87-cbb710191bdb req-fce15cc2-3575-4a64-b148-30e41a264640 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received unexpected event network-vif-unplugged-c519a061-16fb-426a-ba45-ff2fa6d655cd for instance with vm_state active and task_state resize_migrating.
Apr 13 22:06:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updated VIF entry in instance network info cache for port c519a061-16fb-426a-ba45-ff2fa6d655cd. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:06:36 user nova-compute[71325]: DEBUG nova.network.neutron [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updating instance_info_cache with network_info: [{"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:06:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] Releasing lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:37 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Instance destroyed successfully.
Apr 13 22:06:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1601106766',display_name='tempest-ServerActionsTestJSON-server-1601106766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1601106766',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:04:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-r3zpb3tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:06:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=03027926-4eef-4af8-afca-b70f625de6ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1784901700-network", "vif_mac": "fa:16:3e:23:ce:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1784901700-network", "vif_mac": "fa:16:3e:23:ce:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:ce:28,bridge_name='br-int',has_traffic_filtering=True,id=c519a061-16fb-426a-ba45-ff2fa6d655cd,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc519a061-16') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_vif [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:ce:28,bridge_name='br-int',has_traffic_filtering=True,id=c519a061-16fb-426a-ba45-ff2fa6d655cd,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc519a061-16') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc519a061-16, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:37 user nova-compute[71325]: INFO os_vif [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:ce:28,bridge_name='br-int',has_traffic_filtering=True,id=c519a061-16fb-426a-ba45-ff2fa6d655cd,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc519a061-16')
Apr 13 22:06:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JiZrxcnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:06:37 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[749ad324-c1d4-4ce7-91c2-dce74cb16bdc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:06:37 user nova-compute[71325]: No targets found.
Apr 13 22:06:37 user nova-compute[71325]: iSNS:
Apr 13 22:06:37 user nova-compute[71325]: No targets found.
Apr 13 22:06:37 user nova-compute[71325]: STATIC:
Apr 13 22:06:37 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f
Apr 13 22:06:37 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:06:37 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:06:37 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 22:06:37 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:06:37 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:06:37 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772
Apr 13 22:06:37 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:06:37 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:06:37 user nova-compute[71325]: FIRMWARE:
Apr 13 22:06:37 user nova-compute[71325]: No targets found.
Apr 13 22:06:37 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:06:37 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:06:37 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd68e2e8-2591-48d6-a5f4-ef12ac5979ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6a6ecd-5a88-469e-afb3-8fbdea927b21]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:06:37 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:06:37 user nova-compute[71325]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:06:37 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:06:37 user nova-compute[71325]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:06:37 user nova-compute[71325]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:06:37 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5a41b5360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772'): ({'sde'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Removing single pathed devices sde {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6f06fc-7c15-4ea2-a95a-db683b954b25]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cebad7d-5a5f-460d-82ec-5e7bed0b66b4]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flushing IO for device /dev/sde {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f36c10-8ab2-428c-8a58-dd06f03cf2a4]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[29120ea9-92d5-499a-9169-f2ea98072f42]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] SCSI volumes sde have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e29a11-37b8-4c43-962a-21558c4ad82b]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5159b05c-e378-4fe5-8452-c9af0ebc4208]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260]
Apr 13 22:06:37 user nova-compute[71325]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260] successful.
Apr 13 22:06:37 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0916785b-9a48-4cd1-a8e8-bcc930bc6373]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== disconnect_volume: return (361ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received event network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Acquiring lock "03027926-4eef-4af8-afca-b70f625de6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] No waiting events found dispatching network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:06:38 user nova-compute[71325]: WARNING nova.compute.manager [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received unexpected event network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd for instance with vm_state active and task_state resize_migrating.
Apr 13 22:06:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Received event network-vif-plugged-7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Acquiring lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] No waiting events found dispatching network-vif-plugged-7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:06:38 user nova-compute[71325]: WARNING nova.compute.manager [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Received unexpected event network-vif-plugged-7cc730c3-a97b-4fd0-8e8e-25e07a307843 for instance with vm_state building and task_state spawning.
Apr 13 22:06:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Received event network-vif-plugged-7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Acquiring lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] No waiting events found dispatching network-vif-plugged-7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:06:38 user nova-compute[71325]: WARNING nova.compute.manager [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Received unexpected event network-vif-plugged-7cc730c3-a97b-4fd0-8e8e-25e07a307843 for instance with vm_state building and task_state spawning.
Apr 13 22:06:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Port c519a061-16fb-426a-ba45-ff2fa6d655cd binding to destination host user is already ACTIVE {{(pid=71325) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "03027926-4eef-4af8-afca-b70f625de6ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquired lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:06:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.network.neutron [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updating instance_info_cache with network_info: [{"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Releasing lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423599.2982013, 7741644e-2273-4d75-9b4d-8bf386400b07 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:06:39 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] VM Resumed (Lifecycle Event)
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG os_brick.utils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:39 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Instance spawned successfully.
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[55412cf7-1c26-4207-a96e-27907fb5a7bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:06:39 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423599.3000724, 7741644e-2273-4d75-9b4d-8bf386400b07 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:06:39 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] VM Started (Lifecycle Event)
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[600eae97-8e64-4fe8-b9ed-4067a487b79f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[35387ebe-484c-4691-b7e3-86a7a96efad8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc2a186-05fc-4b6e-af75-08bfbf58f06b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:06:39 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:39 user nova-compute[71325]: INFO nova.compute.manager [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Took 5.32 seconds to spawn the instance on the hypervisor.
Apr 13 22:06:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:06:39 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[43caa1d0-6807-40d2-8aa3-fa35a566358c]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:06:39 user nova-compute[71325]: DEBUG os_brick.utils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:06:39 user nova-compute[71325]: INFO nova.compute.manager [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Took 11.23 seconds to build instance.
Apr 13 22:06:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "7741644e-2273-4d75-9b4d-8bf386400b07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.327s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-972b25f9-446a-4a4a-8a9c-037a8919cbb8 req-a653b34d-6fed-4ca1-9572-c29bba73f699 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Received event network-changed-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-972b25f9-446a-4a4a-8a9c-037a8919cbb8 req-a653b34d-6fed-4ca1-9572-c29bba73f699 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Refreshing instance network info cache due to event network-changed-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-972b25f9-446a-4a4a-8a9c-037a8919cbb8 req-a653b34d-6fed-4ca1-9572-c29bba73f699 service nova] Acquiring lock "refresh_cache-940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-972b25f9-446a-4a4a-8a9c-037a8919cbb8 req-a653b34d-6fed-4ca1-9572-c29bba73f699 service nova] Acquired lock "refresh_cache-940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG nova.network.neutron [req-972b25f9-446a-4a4a-8a9c-037a8919cbb8 req-a653b34d-6fed-4ca1-9572-c29bba73f699 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Refreshing network info cache for port 2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:41 user nova-compute[71325]: INFO nova.compute.manager [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Terminating instance
Apr 13 22:06:41 user nova-compute[71325]: DEBUG nova.compute.manager [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG nova.network.neutron [req-972b25f9-446a-4a4a-8a9c-037a8919cbb8 req-a653b34d-6fed-4ca1-9572-c29bba73f699 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Updated VIF entry in instance network info cache for port 2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG nova.network.neutron [req-972b25f9-446a-4a4a-8a9c-037a8919cbb8 req-a653b34d-6fed-4ca1-9572-c29bba73f699 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Updating instance_info_cache with network_info: [{"id": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "address": "fa:16:3e:a8:57:54", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee4b50e-d2", "ovs_interfaceid": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-972b25f9-446a-4a4a-8a9c-037a8919cbb8 req-a653b34d-6fed-4ca1-9572-c29bba73f699 service nova] Releasing lock "refresh_cache-940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Instance destroyed successfully.
Apr 13 22:06:42 user nova-compute[71325]: DEBUG nova.objects.instance [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lazy-loading 'resources' on Instance uuid 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:06:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2025917295',display_name='tempest-TestStampPattern-server-2025917295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2025917295',id=38,image_ref='bd40dedc-e511-4505-afbf-c9ff13ef51b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXtPnwsWU/ZHWadHD9KufzgH+i4W8Whaj89/zf4/lU/5gVOUN68ru0UJiR7TrTwJrSHaGj3qTP3uSclSDGLdxNe17FiKyjg0p2Imd/q5wAr6DX4FJCcSqsRDbLL7AtxQA==',key_name='tempest-TestStampPattern-369348447',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:03:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='388f228079fa45cb91fa08b972132fbe',ramdisk_id='',reservation_id='r-hmq6j8fb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='061e133a-9d17-4ff9-839a-235b05f9dd93',image_min_disk='1',image_min_ram='0',image_owner_id='388f228079fa45cb91fa08b972132fbe',image_owner_project_name='tempest-TestStampPattern-921591052',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-921591052-project-member',image_user_id='26fb3ecc54c84118b2100ff89cbc87f6',owner_project_name='tempest-TestStampPattern-921591052',owner_user_name='tempest-TestStampPattern-921591052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:03:57Z,user_data=None,user_id='26fb3ecc54c84118b2100ff89cbc87f6',uuid=940ee3fc-f7d5-4f22-a3c8-6e4e15018b78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "address": "fa:16:3e:a8:57:54", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee4b50e-d2", "ovs_interfaceid": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:06:42 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Converting VIF {"id": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "address": "fa:16:3e:a8:57:54", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee4b50e-d2", "ovs_interfaceid": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:06:42 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:57:54,bridge_name='br-int',has_traffic_filtering=True,id=2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb,network=Network(a5cfb4cb-723b-4476-8849-b693ce8adbe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee4b50e-d2') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:06:42 user nova-compute[71325]: DEBUG os_vif [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:57:54,bridge_name='br-int',has_traffic_filtering=True,id=2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb,network=Network(a5cfb4cb-723b-4476-8849-b693ce8adbe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee4b50e-d2') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:06:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ee4b50e-d2, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:06:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:06:42 user nova-compute[71325]: INFO os_vif [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:57:54,bridge_name='br-int',has_traffic_filtering=True,id=2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb,network=Network(a5cfb4cb-723b-4476-8849-b693ce8adbe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee4b50e-d2')
Apr 13 22:06:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Deleting instance files /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78_del
Apr 13 22:06:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Deletion of /opt/stack/data/nova/instances/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78_del complete
Apr 13 22:06:42 user nova-compute[71325]: INFO nova.compute.manager [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 22:06:42 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:06:42 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:06:42 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:06:43 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:06:43 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Took 0.79 seconds to deallocate network for instance.
Apr 13 22:06:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-66b6d044-0630-4360-aea7-cff815f82321 req-17b3fe34-dbe1-4495-a03c-e345ea590e3b service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Received event network-vif-deleted-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Received event network-vif-unplugged-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] Acquiring lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] No waiting events found dispatching network-vif-unplugged-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:06:43 user nova-compute[71325]: WARNING nova.compute.manager [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Received unexpected event network-vif-unplugged-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb for instance with vm_state deleted and task_state None.
Apr 13 22:06:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Received event network-vif-plugged-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] Acquiring lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] No waiting events found dispatching network-vif-plugged-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:06:43 user nova-compute[71325]: WARNING nova.compute.manager [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Received unexpected event network-vif-plugged-2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb for instance with vm_state deleted and task_state None.
Apr 13 22:06:43 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:06:43 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:06:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:43 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Deleted allocations for instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78
Apr 13 22:06:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.273s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Starting finish_migration {{(pid=71325) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Instance directory exists: not creating {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 22:06:44 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Creating image(s)
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Ensure instance console log exists: /opt/stack/data/nova/instances/03027926-4eef-4af8-afca-b70f625de6ab/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Start _get_guest_xml network_info=[{"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1784901700-network", "vif_mac": "fa:16:3e:23:ce:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JiZrxcnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '03027926-4eef-4af8-afca-b70f625de6ab', 'attached_at': '2023-04-13T22:06:44.000000', 'detached_at': '', 'volume_id': 'f7e87d6a-37e1-4284-90fb-23b6b89ad772', 'serial': 'f7e87d6a-37e1-4284-90fb-23b6b89ad772'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '8d0224d5-99e8-4763-8c48-b6d898db0fb2', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:06:44 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:06:44 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'vcpu_model' on Instance uuid 03027926-4eef-4af8-afca-b70f625de6ab {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JiZrxcnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:06:44 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:06:44 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:06:44 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cae773-0e47-4aa5-baad-1e22d126700a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:06:44 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62e4131-f45f-4899-afd5-0a37b0ee89da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772] added
Apr 13 22:06:44 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[078b9f6d-601b-4ba9-92a5-926661be0f4e]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3846b8-be1e-43a7-9f37-0ec3145eff03]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JiZrxcnv {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JiZrxcnv" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdf5fee-0983-43e2-810b-7cea27cf31c1]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JiZrxcnv'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed4376d-afcc-44f3-970c-41b0cd4db90a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c537e34-e761-49b9-9682-fe5daed08c0b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:06:44 user nova-compute[71325]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:06:44 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:06:44 user nova-compute[71325]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:06:44 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd5dfda-a835-4e9d-9309-daf39f2f2fb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260]
Apr 13 22:06:44 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260] successful.
Apr 13 22:06:44 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f81f494-6b55-49e8-9aaf-1ad48c7a8ac8]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd20e65-6260-4c51-9407-65cb75c1e5e6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:06:44 user nova-compute[71325]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:06:44 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:06:44 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:06:44 user nova-compute[71325]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:06:44 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:06:44 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb1e98d-4ec9-4f96-94f0-caf9c178a169]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:06:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JiZrxcnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23932653439343566', 'path': '/dev/sdc'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932653439343566', 'path': '/dev/sdc'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1601106766',display_name='tempest-ServerActionsTestJSON-server-1601106766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1601106766',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:04:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-r3zpb3tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:06:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=03027926-4eef-4af8-afca-b70f625de6ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1784901700-network", "vif_mac": "fa:16:3e:23:ce:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1784901700-network", "vif_mac": "fa:16:3e:23:ce:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ce:28,bridge_name='br-int',has_traffic_filtering=True,id=c519a061-16fb-426a-ba45-ff2fa6d655cd,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc519a061-16') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:06:45 user nova-compute[71325]:   <uuid>03027926-4eef-4af8-afca-b70f625de6ab</uuid>
Apr 13 22:06:45 user nova-compute[71325]:   <name>instance-00000029</name>
Apr 13 22:06:45 user nova-compute[71325]:   <memory>196608</memory>
Apr 13 22:06:45 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:06:45 user nova-compute[71325]:   <metadata>
Apr 13 22:06:45 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:06:45 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:06:45 user nova-compute[71325]:       <nova:name>tempest-ServerActionsTestJSON-server-1601106766</nova:name>
Apr 13 22:06:45 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:06:44</nova:creationTime>
Apr 13 22:06:45 user nova-compute[71325]:       <nova:flavor name="m1.micro">
Apr 13 22:06:45 user nova-compute[71325]:         <nova:memory>192</nova:memory>
Apr 13 22:06:45 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:06:45 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:06:45 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:06:45 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:06:45 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:06:45 user nova-compute[71325]:       <nova:owner>
Apr 13 22:06:45 user nova-compute[71325]:         <nova:user uuid="b3db8b01a05b43f68bfd8695253514db">tempest-ServerActionsTestJSON-236976022-project-member</nova:user>
Apr 13 22:06:45 user nova-compute[71325]:         <nova:project uuid="7c086cffbafb4da68f172ab27da232d3">tempest-ServerActionsTestJSON-236976022</nova:project>
Apr 13 22:06:45 user nova-compute[71325]:       </nova:owner>
Apr 13 22:06:45 user nova-compute[71325]:       <nova:ports>
Apr 13 22:06:45 user nova-compute[71325]:         <nova:port uuid="c519a061-16fb-426a-ba45-ff2fa6d655cd">
Apr 13 22:06:45 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 22:06:45 user nova-compute[71325]:         </nova:port>
Apr 13 22:06:45 user nova-compute[71325]:       </nova:ports>
Apr 13 22:06:45 user nova-compute[71325]:     </nova:instance>
Apr 13 22:06:45 user nova-compute[71325]:   </metadata>
Apr 13 22:06:45 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:06:45 user nova-compute[71325]:     <system>
Apr 13 22:06:45 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:06:45 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:06:45 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:06:45 user nova-compute[71325]:       <entry name="serial">03027926-4eef-4af8-afca-b70f625de6ab</entry>
Apr 13 22:06:45 user nova-compute[71325]:       <entry name="uuid">03027926-4eef-4af8-afca-b70f625de6ab</entry>
Apr 13 22:06:45 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:06:45 user nova-compute[71325]:     </system>
Apr 13 22:06:45 user nova-compute[71325]:   </sysinfo>
Apr 13 22:06:45 user nova-compute[71325]:   <os>
Apr 13 22:06:45 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:06:45 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:06:45 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:06:45 user nova-compute[71325]:   </os>
Apr 13 22:06:45 user nova-compute[71325]:   <features>
Apr 13 22:06:45 user nova-compute[71325]:     <acpi/>
Apr 13 22:06:45 user nova-compute[71325]:     <apic/>
Apr 13 22:06:45 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:06:45 user nova-compute[71325]:   </features>
Apr 13 22:06:45 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:06:45 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:06:45 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:06:45 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:06:45 user nova-compute[71325]:   </clock>
Apr 13 22:06:45 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:06:45 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:06:45 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:06:45 user nova-compute[71325]:   </cpu>
Apr 13 22:06:45 user nova-compute[71325]:   <devices>
Apr 13 22:06:45 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 22:06:45 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:06:45 user nova-compute[71325]:       <source dev="/dev/sdc"/>
Apr 13 22:06:45 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:06:45 user nova-compute[71325]:       <serial>f7e87d6a-37e1-4284-90fb-23b6b89ad772</serial>
Apr 13 22:06:45 user nova-compute[71325]:     </disk>
Apr 13 22:06:45 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:06:45 user nova-compute[71325]:       <mac address="fa:16:3e:23:ce:28"/>
Apr 13 22:06:45 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:06:45 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:06:45 user nova-compute[71325]:       <target dev="tapc519a061-16"/>
Apr 13 22:06:45 user nova-compute[71325]:     </interface>
Apr 13 22:06:45 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:06:45 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/03027926-4eef-4af8-afca-b70f625de6ab/console.log" append="off"/>
Apr 13 22:06:45 user nova-compute[71325]:     </serial>
Apr 13 22:06:45 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:06:45 user nova-compute[71325]:     <video>
Apr 13 22:06:45 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:06:45 user nova-compute[71325]:     </video>
Apr 13 22:06:45 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:06:45 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:06:45 user nova-compute[71325]:     </rng>
Apr 13 22:06:45 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:06:45 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:06:45 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:06:45 user nova-compute[71325]:     </memballoon>
Apr 13 22:06:45 user nova-compute[71325]:   </devices>
Apr 13 22:06:45 user nova-compute[71325]: </domain>
Apr 13 22:06:45 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1601106766',display_name='tempest-ServerActionsTestJSON-server-1601106766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1601106766',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:04:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-r3zpb3tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:06:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=03027926-4eef-4af8-afca-b70f625de6ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1784901700-network", "vif_mac": "fa:16:3e:23:ce:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1784901700-network", "vif_mac": "fa:16:3e:23:ce:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ce:28,bridge_name='br-int',has_traffic_filtering=True,id=c519a061-16fb-426a-ba45-ff2fa6d655cd,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc519a061-16') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG os_vif [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ce:28,bridge_name='br-int',has_traffic_filtering=True,id=c519a061-16fb-426a-ba45-ff2fa6d655cd,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc519a061-16') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc519a061-16, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc519a061-16, col_values=(('external_ids', {'iface-id': 'c519a061-16fb-426a-ba45-ff2fa6d655cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:ce:28', 'vm-uuid': '03027926-4eef-4af8-afca-b70f625de6ab'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:45 user nova-compute[71325]: INFO os_vif [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ce:28,bridge_name='br-int',has_traffic_filtering=True,id=c519a061-16fb-426a-ba45-ff2fa6d655cd,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc519a061-16')
Apr 13 22:06:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:06:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] No VIF found with MAC fa:16:3e:23:ce:28, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:06:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-672b8c84-bffa-45d3-a1d0-4f6644fa6ccd req-78edf4e5-a29f-400f-9510-e32840f9be32 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received event network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-672b8c84-bffa-45d3-a1d0-4f6644fa6ccd req-78edf4e5-a29f-400f-9510-e32840f9be32 service nova] Acquiring lock "03027926-4eef-4af8-afca-b70f625de6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-672b8c84-bffa-45d3-a1d0-4f6644fa6ccd req-78edf4e5-a29f-400f-9510-e32840f9be32 service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-672b8c84-bffa-45d3-a1d0-4f6644fa6ccd req-78edf4e5-a29f-400f-9510-e32840f9be32 service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:47 user nova-compute[71325]: DEBUG nova.compute.manager [req-672b8c84-bffa-45d3-a1d0-4f6644fa6ccd req-78edf4e5-a29f-400f-9510-e32840f9be32 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] No waiting events found dispatching network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:06:47 user nova-compute[71325]: WARNING nova.compute.manager [req-672b8c84-bffa-45d3-a1d0-4f6644fa6ccd req-78edf4e5-a29f-400f-9510-e32840f9be32 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received unexpected event network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd for instance with vm_state active and task_state resize_finish.
Apr 13 22:06:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.host [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Removed pending event for 03027926-4eef-4af8-afca-b70f625de6ab due to event {{(pid=71325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 22:06:48 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423608.8917184, 03027926-4eef-4af8-afca-b70f625de6ab => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:06:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] VM Resumed (Lifecycle Event)
Apr 13 22:06:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:06:48 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Instance running successfully.
Apr 13 22:06:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Failed to set time: agent not configured {{(pid=71325) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 13 22:06:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] finish_migration finished successfully. {{(pid=71325) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 13 22:06:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:06:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:06:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 22:06:48 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423608.8947983, 03027926-4eef-4af8-afca-b70f625de6ab => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:06:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] VM Started (Lifecycle Event)
Apr 13 22:06:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:06:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:06:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 22:06:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-2d309c9b-2b60-40b7-a568-69e54b20ef73 req-7cffad97-f038-4a86-8645-6865dc460f43 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received event network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2d309c9b-2b60-40b7-a568-69e54b20ef73 req-7cffad97-f038-4a86-8645-6865dc460f43 service nova] Acquiring lock "03027926-4eef-4af8-afca-b70f625de6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2d309c9b-2b60-40b7-a568-69e54b20ef73 req-7cffad97-f038-4a86-8645-6865dc460f43 service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2d309c9b-2b60-40b7-a568-69e54b20ef73 req-7cffad97-f038-4a86-8645-6865dc460f43 service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-2d309c9b-2b60-40b7-a568-69e54b20ef73 req-7cffad97-f038-4a86-8645-6865dc460f43 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] No waiting events found dispatching network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:06:49 user nova-compute[71325]: WARNING nova.compute.manager [req-2d309c9b-2b60-40b7-a568-69e54b20ef73 req-7cffad97-f038-4a86-8645-6865dc460f43 service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received unexpected event network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd for instance with vm_state resized and task_state None.
Apr 13 22:06:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "e568023a-3163-428f-8b1a-6c854c65f46f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "e568023a-3163-428f-8b1a-6c854c65f46f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:49 user nova-compute[71325]: INFO nova.compute.manager [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Terminating instance
Apr 13 22:06:49 user nova-compute[71325]: DEBUG nova.compute.manager [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-ea693d5b-6de1-414b-b551-20ddd38ae340 req-29c2d2e2-fe95-4979-bf4c-d65c974367c8 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Received event network-vif-unplugged-45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ea693d5b-6de1-414b-b551-20ddd38ae340 req-29c2d2e2-fe95-4979-bf4c-d65c974367c8 service nova] Acquiring lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ea693d5b-6de1-414b-b551-20ddd38ae340 req-29c2d2e2-fe95-4979-bf4c-d65c974367c8 service nova] Lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-ea693d5b-6de1-414b-b551-20ddd38ae340 req-29c2d2e2-fe95-4979-bf4c-d65c974367c8 service nova] Lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-ea693d5b-6de1-414b-b551-20ddd38ae340 req-29c2d2e2-fe95-4979-bf4c-d65c974367c8 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] No waiting events found dispatching network-vif-unplugged-45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:06:49 user nova-compute[71325]: DEBUG nova.compute.manager [req-ea693d5b-6de1-414b-b551-20ddd38ae340 req-29c2d2e2-fe95-4979-bf4c-d65c974367c8 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Received event network-vif-unplugged-45ea22f6-3663-4d12-a479-41c56f1e9bc2 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:06:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Instance destroyed successfully.
Apr 13 22:06:50 user nova-compute[71325]: DEBUG nova.objects.instance [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'resources' on Instance uuid e568023a-3163-428f-8b1a-6c854c65f46f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:06:50 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-43325764',display_name='tempest-AttachVolumeNegativeTest-server-43325764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-43325764',id=39,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAseL4vxxUJqHfcsgelGZfQ5WSQkMbZV0oNUO7DZ0FmjlJimVjmfBMqZLB9Ro1KBgPzyb7m0hg9gAAFNGEPJ4EP6mvcIQ5RqNpMjHJWx3kG1AmT1sGEoeSLLPvqrv6FT+g==',key_name='tempest-keypair-548852854',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='446b51db737947ab9bddd5fc47488bc7',ramdisk_id='',reservation_id='r-vsi34luj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-920375840',owner_user_name='tempest-AttachVolumeNegativeTest-920375840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145c0a177fcc4b94b5480d8806554ac9',uuid=e568023a-3163-428f-8b1a-6c854c65f46f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "address": "fa:16:3e:9e:73:66", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ea22f6-36", "ovs_interfaceid": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:06:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converting VIF {"id": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "address": "fa:16:3e:9e:73:66", "network": {"id": "88d8592d-4fff-4951-a1b8-140984c24696", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1949837102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446b51db737947ab9bddd5fc47488bc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ea22f6-36", "ovs_interfaceid": "45ea22f6-3663-4d12-a479-41c56f1e9bc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:06:50 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:73:66,bridge_name='br-int',has_traffic_filtering=True,id=45ea22f6-3663-4d12-a479-41c56f1e9bc2,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ea22f6-36') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:06:50 user nova-compute[71325]: DEBUG os_vif [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:73:66,bridge_name='br-int',has_traffic_filtering=True,id=45ea22f6-3663-4d12-a479-41c56f1e9bc2,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ea22f6-36') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:06:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45ea22f6-36, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:06:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:06:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:50 user nova-compute[71325]: INFO os_vif [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:73:66,bridge_name='br-int',has_traffic_filtering=True,id=45ea22f6-3663-4d12-a479-41c56f1e9bc2,network=Network(88d8592d-4fff-4951-a1b8-140984c24696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ea22f6-36')
Apr 13 22:06:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Deleting instance files /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f_del
Apr 13 22:06:50 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Deletion of /opt/stack/data/nova/instances/e568023a-3163-428f-8b1a-6c854c65f46f_del complete
Apr 13 22:06:50 user nova-compute[71325]: INFO nova.compute.manager [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 13 22:06:50 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:06:50 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:06:50 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:06:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:51 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:06:51 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Took 0.76 seconds to deallocate network for instance.
Apr 13 22:06:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:51 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:06:51 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:06:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:51 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Deleted allocations for instance e568023a-3163-428f-8b1a-6c854c65f46f
Apr 13 22:06:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "e568023a-3163-428f-8b1a-6c854c65f46f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.158s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-90c42c69-721d-4838-83b4-197e142f105f req-3fca2f50-70d6-46a1-b32c-a7e71e912e79 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Received event network-vif-plugged-45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-90c42c69-721d-4838-83b4-197e142f105f req-3fca2f50-70d6-46a1-b32c-a7e71e912e79 service nova] Acquiring lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:06:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-90c42c69-721d-4838-83b4-197e142f105f req-3fca2f50-70d6-46a1-b32c-a7e71e912e79 service nova] Lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:06:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-90c42c69-721d-4838-83b4-197e142f105f req-3fca2f50-70d6-46a1-b32c-a7e71e912e79 service nova] Lock "e568023a-3163-428f-8b1a-6c854c65f46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:06:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-90c42c69-721d-4838-83b4-197e142f105f req-3fca2f50-70d6-46a1-b32c-a7e71e912e79 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] No waiting events found dispatching network-vif-plugged-45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:06:52 user nova-compute[71325]: WARNING nova.compute.manager [req-90c42c69-721d-4838-83b4-197e142f105f req-3fca2f50-70d6-46a1-b32c-a7e71e912e79 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Received unexpected event network-vif-plugged-45ea22f6-3663-4d12-a479-41c56f1e9bc2 for instance with vm_state deleted and task_state None.
Apr 13 22:06:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-90c42c69-721d-4838-83b4-197e142f105f req-3fca2f50-70d6-46a1-b32c-a7e71e912e79 service nova] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Received event network-vif-deleted-45ea22f6-3663-4d12-a479-41c56f1e9bc2 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:06:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:06:57 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423602.0996237, 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:06:57 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] VM Stopped (Lifecycle Event)
Apr 13 22:06:57 user nova-compute[71325]: DEBUG nova.compute.manager [None req-04e03151-b9fa-4935-b4d3-64444beed64d None None] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "bfcfa307-25f3-43e0-837b-704b5cd7783f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:00 user nova-compute[71325]: INFO nova.compute.manager [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Terminating instance
Apr 13 22:07:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-455fdeb7-888d-45bf-9f87-d17c7db8e24b req-180f2b13-6556-4b58-9d39-de72a4ca3dcf service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Received event network-vif-unplugged-67f4855a-44cd-42ff-87f6-9f0704b9960a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-455fdeb7-888d-45bf-9f87-d17c7db8e24b req-180f2b13-6556-4b58-9d39-de72a4ca3dcf service nova] Acquiring lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-455fdeb7-888d-45bf-9f87-d17c7db8e24b req-180f2b13-6556-4b58-9d39-de72a4ca3dcf service nova] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-455fdeb7-888d-45bf-9f87-d17c7db8e24b req-180f2b13-6556-4b58-9d39-de72a4ca3dcf service nova] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-455fdeb7-888d-45bf-9f87-d17c7db8e24b req-180f2b13-6556-4b58-9d39-de72a4ca3dcf service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] No waiting events found dispatching network-vif-unplugged-67f4855a-44cd-42ff-87f6-9f0704b9960a {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-455fdeb7-888d-45bf-9f87-d17c7db8e24b req-180f2b13-6556-4b58-9d39-de72a4ca3dcf service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Received event network-vif-unplugged-67f4855a-44cd-42ff-87f6-9f0704b9960a for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:00 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Instance destroyed successfully.
Apr 13 22:07:00 user nova-compute[71325]: DEBUG nova.objects.instance [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'resources' on Instance uuid bfcfa307-25f3-43e0-837b-704b5cd7783f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-297643457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-297643457',id=29,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:57:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11a30fba887e4114be856d26b47a8e55',ramdisk_id='',reservation_id='r-cnf6tw5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-33854562',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:59:35Z,user_data=None,user_id='0ab740920cac4befac62a72f7ce5a817',uuid=bfcfa307-25f3-43e0-837b-704b5cd7783f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "address": "fa:16:3e:0c:02:5e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4855a-44", "ovs_interfaceid": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converting VIF {"id": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "address": "fa:16:3e:0c:02:5e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4855a-44", "ovs_interfaceid": "67f4855a-44cd-42ff-87f6-9f0704b9960a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:02:5e,bridge_name='br-int',has_traffic_filtering=True,id=67f4855a-44cd-42ff-87f6-9f0704b9960a,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f4855a-44') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG os_vif [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:02:5e,bridge_name='br-int',has_traffic_filtering=True,id=67f4855a-44cd-42ff-87f6-9f0704b9960a,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f4855a-44') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67f4855a-44, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:07:00 user nova-compute[71325]: INFO os_vif [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:02:5e,bridge_name='br-int',has_traffic_filtering=True,id=67f4855a-44cd-42ff-87f6-9f0704b9960a,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f4855a-44')
Apr 13 22:07:00 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Deleting instance files /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f_del
Apr 13 22:07:00 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Deletion of /opt/stack/data/nova/instances/bfcfa307-25f3-43e0-837b-704b5cd7783f_del complete
Apr 13 22:07:00 user nova-compute[71325]: INFO nova.compute.manager [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 13 22:07:00 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:07:00 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:07:01 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:07:01 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Took 0.50 seconds to deallocate network for instance.
Apr 13 22:07:01 user nova-compute[71325]: DEBUG nova.compute.manager [req-fc28757d-6989-4d4c-8ccf-4baedcded2be req-5e527df3-715e-4dcd-ac31-582201e34401 service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Received event network-vif-deleted-67f4855a-44cd-42ff-87f6-9f0704b9960a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:07:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:01 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Refreshing inventories for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 22:07:01 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Updating ProviderTree inventory for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 22:07:01 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Updating inventory in ProviderTree for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 22:07:01 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Refreshing aggregate associations for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55, aggregates: None {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 22:07:01 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Refreshing trait associations for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 22:07:01 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:07:01 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:07:01 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:01 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Deleted allocations for instance bfcfa307-25f3-43e0-837b-704b5cd7783f
Apr 13 22:07:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.053s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:02 user nova-compute[71325]: DEBUG nova.compute.manager [req-e303d0f9-2afb-45a9-8694-82c26b4e0cd6 req-76759ed3-1f99-47df-8ca5-ae300e8197a0 service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Received event network-vif-plugged-67f4855a-44cd-42ff-87f6-9f0704b9960a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:07:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e303d0f9-2afb-45a9-8694-82c26b4e0cd6 req-76759ed3-1f99-47df-8ca5-ae300e8197a0 service nova] Acquiring lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e303d0f9-2afb-45a9-8694-82c26b4e0cd6 req-76759ed3-1f99-47df-8ca5-ae300e8197a0 service nova] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:02 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e303d0f9-2afb-45a9-8694-82c26b4e0cd6 req-76759ed3-1f99-47df-8ca5-ae300e8197a0 service nova] Lock "bfcfa307-25f3-43e0-837b-704b5cd7783f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:02 user nova-compute[71325]: DEBUG nova.compute.manager [req-e303d0f9-2afb-45a9-8694-82c26b4e0cd6 req-76759ed3-1f99-47df-8ca5-ae300e8197a0 service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] No waiting events found dispatching network-vif-plugged-67f4855a-44cd-42ff-87f6-9f0704b9960a {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:07:02 user nova-compute[71325]: WARNING nova.compute.manager [req-e303d0f9-2afb-45a9-8694-82c26b4e0cd6 req-76759ed3-1f99-47df-8ca5-ae300e8197a0 service nova] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Received unexpected event network-vif-plugged-67f4855a-44cd-42ff-87f6-9f0704b9960a for instance with vm_state deleted and task_state None.
Apr 13 22:07:05 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423610.3226655, e568023a-3163-428f-8b1a-6c854c65f46f => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:07:05 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] VM Stopped (Lifecycle Event)
Apr 13 22:07:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-b356a4dc-4a96-46e6-b6db-9b233d6f685b None None] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:07:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:15 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:07:15 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423620.8685527, bfcfa307-25f3-43e0-837b-704b5cd7783f => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:07:15 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] VM Stopped (Lifecycle Event)
Apr 13 22:07:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-9102efce-1b86-4516-94ca-ffeda196d9d2 None None] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:07:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:18 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:07:19 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:07:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:07:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:07:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:07:19 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:07:20 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Updating instance_info_cache with network_info: [{"id": "f00a6c25-29d8-4444-8128-ba174833d8fe", "address": "fa:16:3e:5c:ba:0a", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00a6c25-29", "ovs_interfaceid": "f00a6c25-29d8-4444-8128-ba174833d8fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:07:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:07:20 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:07:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:07:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:21 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:07:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:21 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:07:21 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:07:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:21 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:07:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:22 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:22 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:07:23 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:07:23 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:07:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8101MB free_disk=26.01202392578125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Applying migration context for instance 03027926-4eef-4af8-afca-b70f625de6ab as it has an incoming, in-progress migration 3695c41c-55d4-40e7-a150-1984d1dbd2ee. Migration status is finished {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 22:07:23 user nova-compute[71325]: INFO nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updating resource usage from migration 3695c41c-55d4-40e7-a150-1984d1dbd2ee
Apr 13 22:07:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 6fbf2022-b069-440f-8513-6d107f0a7180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ada4ed22-c00b-47cd-885b-58d7eceff652 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 7741644e-2273-4d75-9b4d-8bf386400b07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Migration 3695c41c-55d4-40e7-a150-1984d1dbd2ee is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 03027926-4eef-4af8-afca-b70f625de6ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:07:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:07:26 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:07:26 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:07:27 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:07:27 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:07:27 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:07:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:31 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:07:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:07:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:07:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:07:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:07:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-31d061c4-10ae-41c9-a199-a39034b78494 req-7fe40e4c-dfa6-400c-8280-2f821f810c98 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Received event network-changed-f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-31d061c4-10ae-41c9-a199-a39034b78494 req-7fe40e4c-dfa6-400c-8280-2f821f810c98 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Refreshing instance network info cache due to event network-changed-f00a6c25-29d8-4444-8128-ba174833d8fe. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-31d061c4-10ae-41c9-a199-a39034b78494 req-7fe40e4c-dfa6-400c-8280-2f821f810c98 service nova] Acquiring lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-31d061c4-10ae-41c9-a199-a39034b78494 req-7fe40e4c-dfa6-400c-8280-2f821f810c98 service nova] Acquired lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-31d061c4-10ae-41c9-a199-a39034b78494 req-7fe40e4c-dfa6-400c-8280-2f821f810c98 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Refreshing network info cache for port f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "061e133a-9d17-4ff9-839a-235b05f9dd93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:37 user nova-compute[71325]: INFO nova.compute.manager [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Terminating instance
Apr 13 22:07:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-31d061c4-10ae-41c9-a199-a39034b78494 req-7fe40e4c-dfa6-400c-8280-2f821f810c98 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Updated VIF entry in instance network info cache for port f00a6c25-29d8-4444-8128-ba174833d8fe. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG nova.network.neutron [req-31d061c4-10ae-41c9-a199-a39034b78494 req-7fe40e4c-dfa6-400c-8280-2f821f810c98 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Updating instance_info_cache with network_info: [{"id": "f00a6c25-29d8-4444-8128-ba174833d8fe", "address": "fa:16:3e:5c:ba:0a", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00a6c25-29", "ovs_interfaceid": "f00a6c25-29d8-4444-8128-ba174833d8fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:07:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-31d061c4-10ae-41c9-a199-a39034b78494 req-7fe40e4c-dfa6-400c-8280-2f821f810c98 service nova] Releasing lock "refresh_cache-061e133a-9d17-4ff9-839a-235b05f9dd93" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:07:38 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Instance destroyed successfully.
Apr 13 22:07:38 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lazy-loading 'resources' on Instance uuid 061e133a-9d17-4ff9-839a-235b05f9dd93 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-421020363',display_name='tempest-TestStampPattern-server-421020363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-421020363',id=35,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXtPnwsWU/ZHWadHD9KufzgH+i4W8Whaj89/zf4/lU/5gVOUN68ru0UJiR7TrTwJrSHaGj3qTP3uSclSDGLdxNe17FiKyjg0p2Imd/q5wAr6DX4FJCcSqsRDbLL7AtxQA==',key_name='tempest-TestStampPattern-369348447',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='388f228079fa45cb91fa08b972132fbe',ramdisk_id='',reservation_id='r-c6vrh1nj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-921591052',owner_user_name='tempest-TestStampPattern-921591052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:03:45Z,user_data=None,user_id='26fb3ecc54c84118b2100ff89cbc87f6',uuid=061e133a-9d17-4ff9-839a-235b05f9dd93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f00a6c25-29d8-4444-8128-ba174833d8fe", "address": "fa:16:3e:5c:ba:0a", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00a6c25-29", "ovs_interfaceid": "f00a6c25-29d8-4444-8128-ba174833d8fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Converting VIF {"id": "f00a6c25-29d8-4444-8128-ba174833d8fe", "address": "fa:16:3e:5c:ba:0a", "network": {"id": "a5cfb4cb-723b-4476-8849-b693ce8adbe5", "bridge": "br-int", "label": "tempest-TestStampPattern-1203319667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388f228079fa45cb91fa08b972132fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00a6c25-29", "ovs_interfaceid": "f00a6c25-29d8-4444-8128-ba174833d8fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ba:0a,bridge_name='br-int',has_traffic_filtering=True,id=f00a6c25-29d8-4444-8128-ba174833d8fe,network=Network(a5cfb4cb-723b-4476-8849-b693ce8adbe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf00a6c25-29') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG os_vif [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ba:0a,bridge_name='br-int',has_traffic_filtering=True,id=f00a6c25-29d8-4444-8128-ba174833d8fe,network=Network(a5cfb4cb-723b-4476-8849-b693ce8adbe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf00a6c25-29') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf00a6c25-29, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:07:38 user nova-compute[71325]: INFO os_vif [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ba:0a,bridge_name='br-int',has_traffic_filtering=True,id=f00a6c25-29d8-4444-8128-ba174833d8fe,network=Network(a5cfb4cb-723b-4476-8849-b693ce8adbe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf00a6c25-29')
Apr 13 22:07:38 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Deleting instance files /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93_del
Apr 13 22:07:38 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Deletion of /opt/stack/data/nova/instances/061e133a-9d17-4ff9-839a-235b05f9dd93_del complete
Apr 13 22:07:38 user nova-compute[71325]: INFO nova.compute.manager [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 22:07:38 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-81e5c55c-58c3-4719-b83c-3be00b5134f0 req-29e0f5ce-28ea-4387-9797-cb8b7e36ba0c service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Received event network-vif-deleted-f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:07:38 user nova-compute[71325]: INFO nova.compute.manager [req-81e5c55c-58c3-4719-b83c-3be00b5134f0 req-29e0f5ce-28ea-4387-9797-cb8b7e36ba0c service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Neutron deleted interface f00a6c25-29d8-4444-8128-ba174833d8fe; detaching it from the instance and deleting it from the info cache
Apr 13 22:07:38 user nova-compute[71325]: DEBUG nova.network.neutron [req-81e5c55c-58c3-4719-b83c-3be00b5134f0 req-29e0f5ce-28ea-4387-9797-cb8b7e36ba0c service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:07:38 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Took 0.50 seconds to deallocate network for instance.
Apr 13 22:07:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-81e5c55c-58c3-4719-b83c-3be00b5134f0 req-29e0f5ce-28ea-4387-9797-cb8b7e36ba0c service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Detach interface failed, port_id=f00a6c25-29d8-4444-8128-ba174833d8fe, reason: Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 could not be found. {{(pid=71325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:07:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:38 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Deleted allocations for instance 061e133a-9d17-4ff9-839a-235b05f9dd93
Apr 13 22:07:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.775s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Received event network-vif-unplugged-f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:07:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] Acquiring lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] No waiting events found dispatching network-vif-unplugged-f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:07:39 user nova-compute[71325]: WARNING nova.compute.manager [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Received unexpected event network-vif-unplugged-f00a6c25-29d8-4444-8128-ba174833d8fe for instance with vm_state deleted and task_state None.
Apr 13 22:07:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Received event network-vif-plugged-f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:07:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] Acquiring lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] Lock "061e133a-9d17-4ff9-839a-235b05f9dd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] No waiting events found dispatching network-vif-plugged-f00a6c25-29d8-4444-8128-ba174833d8fe {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:07:39 user nova-compute[71325]: WARNING nova.compute.manager [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Received unexpected event network-vif-plugged-f00a6c25-29d8-4444-8128-ba174833d8fe for instance with vm_state deleted and task_state None.
Apr 13 22:07:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:47 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:47 user nova-compute[71325]: INFO nova.compute.manager [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Unshelving
Apr 13 22:07:47 user nova-compute[71325]: INFO nova.virt.block_device [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Booting with volume 23dc11c8-0976-4037-a188-9067c88d8f0a at /dev/vda
Apr 13 22:07:48 user nova-compute[71325]: DEBUG os_brick.utils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bda69c7-d57f-47e4-a7f8-c9e79cd09c7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a2e9c3-4ad8-4f07-82ef-57e481a9effe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[95484694-855f-4441-bd69-03773de2a912]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e97aa0-f3c4-462e-bab8-a0d516dd5c5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:07:48 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:07:48 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa25ce2-cb86-48a6-a605-48287f42d854]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG os_brick.utils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:07:48 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updating existing volume attachment record: 55159e47-d147-4188-a93f-ce496ab00303 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "6fbf2022-b069-440f-8513-6d107f0a7180" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:50 user nova-compute[71325]: INFO nova.compute.manager [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Terminating instance
Apr 13 22:07:50 user nova-compute[71325]: DEBUG nova.compute.manager [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG nova.compute.manager [req-48030271-fcf2-4502-b3d2-c28753143c6b req-4d1f3722-1610-4e60-a7f6-3b460af66692 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-vif-unplugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-48030271-fcf2-4502-b3d2-c28753143c6b req-4d1f3722-1610-4e60-a7f6-3b460af66692 service nova] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-48030271-fcf2-4502-b3d2-c28753143c6b req-4d1f3722-1610-4e60-a7f6-3b460af66692 service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-48030271-fcf2-4502-b3d2-c28753143c6b req-4d1f3722-1610-4e60-a7f6-3b460af66692 service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG nova.compute.manager [req-48030271-fcf2-4502-b3d2-c28753143c6b req-4d1f3722-1610-4e60-a7f6-3b460af66692 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] No waiting events found dispatching network-vif-unplugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:07:50 user nova-compute[71325]: DEBUG nova.compute.manager [req-48030271-fcf2-4502-b3d2-c28753143c6b req-4d1f3722-1610-4e60-a7f6-3b460af66692 service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-vif-unplugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:51 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Instance destroyed successfully.
Apr 13 22:07:51 user nova-compute[71325]: DEBUG nova.objects.instance [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'resources' on Instance uuid 6fbf2022-b069-440f-8513-6d107f0a7180 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1476604230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1476604230',id=19,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11a30fba887e4114be856d26b47a8e55',ramdisk_id='',reservation_id='r-t2ph803w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-33854562',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:55:52Z,user_data=None,user_id='0ab740920cac4befac62a72f7ce5a817',uuid=6fbf2022-b069-440f-8513-6d107f0a7180,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converting VIF {"id": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "address": "fa:16:3e:2f:96:1e", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee95846-68", "ovs_interfaceid": "fee95846-6886-4a1a-b7cb-53bd1c1977d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=fee95846-6886-4a1a-b7cb-53bd1c1977d8,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95846-68') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_vif [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=fee95846-6886-4a1a-b7cb-53bd1c1977d8,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95846-68') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfee95846-68, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:51 user nova-compute[71325]: INFO os_vif [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=fee95846-6886-4a1a-b7cb-53bd1c1977d8,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee95846-68')
Apr 13 22:07:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVSNAbZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:07:51 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cef20e5-60da-4f53-a0db-6345e8320f1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:07:51 user nova-compute[71325]: No targets found.
Apr 13 22:07:51 user nova-compute[71325]: iSNS:
Apr 13 22:07:51 user nova-compute[71325]: No targets found.
Apr 13 22:07:51 user nova-compute[71325]: STATIC:
Apr 13 22:07:51 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f
Apr 13 22:07:51 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:07:51 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:07:51 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce
Apr 13 22:07:51 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:07:51 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:07:51 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772
Apr 13 22:07:51 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:07:51 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:07:51 user nova-compute[71325]: FIRMWARE:
Apr 13 22:07:51 user nova-compute[71325]: No targets found.
Apr 13 22:07:51 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:07:51 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:07:51 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f500026-460f-41c2-aae4-883fbe12e89c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[265aa1b1-871d-4182-a7ed-3711f0c2a828]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:07:51 user nova-compute[71325]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:07:51 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:07:51 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce (non-flash)
Apr 13 22:07:51 user nova-compute[71325]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:07:51 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:07:51 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c419ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce'): ({'sdd'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Removing single pathed devices sdd {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6846a105-fc63-4a30-927a-6a68f90e5fe9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d220914e-ce04-49c0-8322-0b71331a50fe]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flushing IO for device /dev/sdd {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb7269a-3b5f-49a8-91db-c76d636b5bcc]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb039744-f6df-4f85-916f-c3949abd568d]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] SCSI volumes sdd have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[144946be-4579-4229-8182-d1d99d56f588]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0d45d8-800f-44a3-9f71-c331c7391b4d]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce, portal: 172.16.0.220,3260]
Apr 13 22:07:51 user nova-compute[71325]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce, portal: 172.16.0.220,3260] successful.
Apr 13 22:07:51 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e3f9d31-e4a2-4e3d-9823-819f1c1244ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3af8d3e-fa8b-4356-bc6e-1a847cfcd698]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] <== disconnect_volume: return (330ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:07:51 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Deleting instance files /opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180_del
Apr 13 22:07:51 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Deletion of /opt/stack/data/nova/instances/6fbf2022-b069-440f-8513-6d107f0a7180_del complete
Apr 13 22:07:51 user nova-compute[71325]: INFO nova.compute.manager [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 13 22:07:51 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:07:51 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:07:52 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:07:52 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Took 0.46 seconds to deallocate network for instance.
Apr 13 22:07:52 user nova-compute[71325]: DEBUG nova.compute.manager [req-c96338f6-e5c7-4d9a-a77a-fef10437a49d req-f6c2424b-62d7-4181-b68f-32add63b7a0a service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-vif-deleted-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:07:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG nova.objects.instance [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lazy-loading 'pci_requests' on Instance uuid a70f4f57-2a18-4489-9f0d-e31e10d66fb0 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-91aa9c3d-069e-48a3-a285-48ec08d9da51 req-832a6d3c-a00d-4aaf-879b-90dc482fcbcb service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-91aa9c3d-069e-48a3-a285-48ec08d9da51 req-832a6d3c-a00d-4aaf-879b-90dc482fcbcb service nova] Acquiring lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-91aa9c3d-069e-48a3-a285-48ec08d9da51 req-832a6d3c-a00d-4aaf-879b-90dc482fcbcb service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-91aa9c3d-069e-48a3-a285-48ec08d9da51 req-832a6d3c-a00d-4aaf-879b-90dc482fcbcb service nova] Lock "6fbf2022-b069-440f-8513-6d107f0a7180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-91aa9c3d-069e-48a3-a285-48ec08d9da51 req-832a6d3c-a00d-4aaf-879b-90dc482fcbcb service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] No waiting events found dispatching network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:07:53 user nova-compute[71325]: WARNING nova.compute.manager [req-91aa9c3d-069e-48a3-a285-48ec08d9da51 req-832a6d3c-a00d-4aaf-879b-90dc482fcbcb service nova] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Received unexpected event network-vif-plugged-fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance with vm_state active and task_state deleting.
Apr 13 22:07:53 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423658.0470805, 061e133a-9d17-4ff9-839a-235b05f9dd93 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:07:53 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] VM Stopped (Lifecycle Event)
Apr 13 22:07:53 user nova-compute[71325]: DEBUG nova.objects.instance [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lazy-loading 'numa_topology' on Instance uuid a70f4f57-2a18-4489-9f0d-e31e10d66fb0 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:07:53 user nova-compute[71325]: INFO nova.compute.manager [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Took 0.83 seconds to detach 1 volumes for instance.
Apr 13 22:07:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a747085d-39a6-485d-af85-ae583f83e7b8 None None] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:07:53 user nova-compute[71325]: INFO nova.compute.claims [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Claim successful on node user
Apr 13 22:07:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.281s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:53 user nova-compute[71325]: INFO nova.network.neutron [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updating port 9bbf8f11-4979-445b-b429-c2b404283afc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:07:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:53 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Deleted allocations for instance 6fbf2022-b069-440f-8513-6d107f0a7180
Apr 13 22:07:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "6fbf2022-b069-440f-8513-6d107f0a7180" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.236s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:07:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquired lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:07:54 user nova-compute[71325]: DEBUG nova.network.neutron [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:07:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-4e0bb747-a5fd-4995-8a00-347fbf284f40 req-f10bf76c-b427-4c69-b0b2-877606b5e82e service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-changed-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:07:54 user nova-compute[71325]: DEBUG nova.compute.manager [req-4e0bb747-a5fd-4995-8a00-347fbf284f40 req-f10bf76c-b427-4c69-b0b2-877606b5e82e service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Refreshing instance network info cache due to event network-changed-9bbf8f11-4979-445b-b429-c2b404283afc. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:07:54 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4e0bb747-a5fd-4995-8a00-347fbf284f40 req-f10bf76c-b427-4c69-b0b2-877606b5e82e service nova] Acquiring lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:07:54 user nova-compute[71325]: DEBUG nova.network.neutron [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updating instance_info_cache with network_info: [{"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Releasing lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:07:55 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Creating image(s)
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Ensure instance console log exists: /opt/stack/data/nova/instances/a70f4f57-2a18-4489-9f0d-e31e10d66fb0/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Start _get_guest_xml network_info=[{"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvFlQGDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a70f4f57-2a18-4489-9f0d-e31e10d66fb0', 'attached_at': '', 'detached_at': '', 'volume_id': '23dc11c8-0976-4037-a188-9067c88d8f0a', 'serial': '23dc11c8-0976-4037-a188-9067c88d8f0a'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '55159e47-d147-4188-a93f-ce496ab00303', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4e0bb747-a5fd-4995-8a00-347fbf284f40 req-f10bf76c-b427-4c69-b0b2-877606b5e82e service nova] Acquired lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.network.neutron [req-4e0bb747-a5fd-4995-8a00-347fbf284f40 req-f10bf76c-b427-4c69-b0b2-877606b5e82e service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Refreshing network info cache for port 9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:07:55 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:07:55 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.objects.instance [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lazy-loading 'vcpu_model' on Instance uuid a70f4f57-2a18-4489-9f0d-e31e10d66fb0 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvFlQGDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:07:55 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:07:55 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:07:55 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcd4ac3-6e4e-49c8-8a57-3aa08fa7220e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:07:55 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10972e2-7d70-4935-8f63-0278f4277f4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a] added
Apr 13 22:07:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ef0596-8a11-4d23-a24a-540433e92135]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf8af1e-4ca7-4958-bcfd-25b12fc62fa3]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvFlQGDo {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvFlQGDo" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3cc0f3-e682-4da1-8415-2cce9ea9bc23]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HvFlQGDo'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[feffcbcc-3ce2-463b-993c-56f74dc0c332]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc101ec-4627-411d-a19d-0a8637f6dc50]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:07:55 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:07:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:07:55 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:07:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb29d0a1-b29c-4f3d-8ccf-ca501b047b20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260]
Apr 13 22:07:55 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260] successful.
Apr 13 22:07:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f405e7-bd3b-43a9-8849-000a6005d6b9]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d1aa6d-60d8-49ec-91a4-e3d38bcbbf2f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:07:55 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:07:55 user nova-compute[71325]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:07:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:07:55 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:07:55 user nova-compute[71325]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:07:55 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdad206-cdf1-44c6-b179-aedec9eaf3bc]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvFlQGDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.network.neutron [req-4e0bb747-a5fd-4995-8a00-347fbf284f40 req-f10bf76c-b427-4c69-b0b2-877606b5e82e service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updated VIF entry in instance network info cache for port 9bbf8f11-4979-445b-b429-c2b404283afc. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG nova.network.neutron [req-4e0bb747-a5fd-4995-8a00-347fbf284f40 req-f10bf76c-b427-4c69-b0b2-877606b5e82e service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updating instance_info_cache with network_info: [{"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:07:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4e0bb747-a5fd-4995-8a00-347fbf284f40 req-f10bf76c-b427-4c69-b0b2-877606b5e82e service nova] Releasing lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23637336166633531', 'path': '/dev/sdd'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637336166633531', 'path': '/dev/sdd'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T22:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1022673409',display_name='tempest-TestShelveInstance-server-1022673409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1022673409',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-299000327',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f16c57e44d2f456cab919015f4b9bb4b',ramdisk_id='',reservation_id='r-29a2f5a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1496514884',owner_user_name='tempest-TestShelveInstance-1496514884-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:07:48Z,user_data=None,user_id='c8ba9f99764b4e61ac0ed632000fc672',uuid=a70f4f57-2a18-4489-9f0d-e31e10d66fb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Converting VIF {"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:2a:33,bridge_name='br-int',has_traffic_filtering=True,id=9bbf8f11-4979-445b-b429-c2b404283afc,network=Network(42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bbf8f11-49') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG nova.objects.instance [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lazy-loading 'pci_devices' on Instance uuid a70f4f57-2a18-4489-9f0d-e31e10d66fb0 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:07:56 user nova-compute[71325]:   <uuid>a70f4f57-2a18-4489-9f0d-e31e10d66fb0</uuid>
Apr 13 22:07:56 user nova-compute[71325]:   <name>instance-00000028</name>
Apr 13 22:07:56 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:07:56 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:07:56 user nova-compute[71325]:   <metadata>
Apr 13 22:07:56 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:07:56 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:07:56 user nova-compute[71325]:       <nova:name>tempest-TestShelveInstance-server-1022673409</nova:name>
Apr 13 22:07:56 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:07:55</nova:creationTime>
Apr 13 22:07:56 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:07:56 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:07:56 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:07:56 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:07:56 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:07:56 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:07:56 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:07:56 user nova-compute[71325]:       <nova:owner>
Apr 13 22:07:56 user nova-compute[71325]:         <nova:user uuid="c8ba9f99764b4e61ac0ed632000fc672">tempest-TestShelveInstance-1496514884-project-member</nova:user>
Apr 13 22:07:56 user nova-compute[71325]:         <nova:project uuid="f16c57e44d2f456cab919015f4b9bb4b">tempest-TestShelveInstance-1496514884</nova:project>
Apr 13 22:07:56 user nova-compute[71325]:       </nova:owner>
Apr 13 22:07:56 user nova-compute[71325]:       <nova:ports>
Apr 13 22:07:56 user nova-compute[71325]:         <nova:port uuid="9bbf8f11-4979-445b-b429-c2b404283afc">
Apr 13 22:07:56 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 22:07:56 user nova-compute[71325]:         </nova:port>
Apr 13 22:07:56 user nova-compute[71325]:       </nova:ports>
Apr 13 22:07:56 user nova-compute[71325]:     </nova:instance>
Apr 13 22:07:56 user nova-compute[71325]:   </metadata>
Apr 13 22:07:56 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:07:56 user nova-compute[71325]:     <system>
Apr 13 22:07:56 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:07:56 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:07:56 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:07:56 user nova-compute[71325]:       <entry name="serial">a70f4f57-2a18-4489-9f0d-e31e10d66fb0</entry>
Apr 13 22:07:56 user nova-compute[71325]:       <entry name="uuid">a70f4f57-2a18-4489-9f0d-e31e10d66fb0</entry>
Apr 13 22:07:56 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:07:56 user nova-compute[71325]:     </system>
Apr 13 22:07:56 user nova-compute[71325]:   </sysinfo>
Apr 13 22:07:56 user nova-compute[71325]:   <os>
Apr 13 22:07:56 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:07:56 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:07:56 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:07:56 user nova-compute[71325]:   </os>
Apr 13 22:07:56 user nova-compute[71325]:   <features>
Apr 13 22:07:56 user nova-compute[71325]:     <acpi/>
Apr 13 22:07:56 user nova-compute[71325]:     <apic/>
Apr 13 22:07:56 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:07:56 user nova-compute[71325]:   </features>
Apr 13 22:07:56 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:07:56 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:07:56 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:07:56 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:07:56 user nova-compute[71325]:   </clock>
Apr 13 22:07:56 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:07:56 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:07:56 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:07:56 user nova-compute[71325]:   </cpu>
Apr 13 22:07:56 user nova-compute[71325]:   <devices>
Apr 13 22:07:56 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 22:07:56 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:07:56 user nova-compute[71325]:       <source dev="/dev/sdd"/>
Apr 13 22:07:56 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:07:56 user nova-compute[71325]:       <serial>23dc11c8-0976-4037-a188-9067c88d8f0a</serial>
Apr 13 22:07:56 user nova-compute[71325]:     </disk>
Apr 13 22:07:56 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:07:56 user nova-compute[71325]:       <mac address="fa:16:3e:37:2a:33"/>
Apr 13 22:07:56 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:07:56 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:07:56 user nova-compute[71325]:       <target dev="tap9bbf8f11-49"/>
Apr 13 22:07:56 user nova-compute[71325]:     </interface>
Apr 13 22:07:56 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:07:56 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/a70f4f57-2a18-4489-9f0d-e31e10d66fb0/console.log" append="off"/>
Apr 13 22:07:56 user nova-compute[71325]:     </serial>
Apr 13 22:07:56 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:07:56 user nova-compute[71325]:     <video>
Apr 13 22:07:56 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:07:56 user nova-compute[71325]:     </video>
Apr 13 22:07:56 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:07:56 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:07:56 user nova-compute[71325]:     </rng>
Apr 13 22:07:56 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:07:56 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:07:56 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:07:56 user nova-compute[71325]:     </memballoon>
Apr 13 22:07:56 user nova-compute[71325]:   </devices>
Apr 13 22:07:56 user nova-compute[71325]: </domain>
Apr 13 22:07:56 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T22:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1022673409',display_name='tempest-TestShelveInstance-server-1022673409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1022673409',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-299000327',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f16c57e44d2f456cab919015f4b9bb4b',ramdisk_id='',reservation_id='r-29a2f5a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1496514884',owner_user_name='tempest-TestShelveInstance-1496514884-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:07:48Z,user_data=None,user_id='c8ba9f99764b4e61ac0ed632000fc672',uuid=a70f4f57-2a18-4489-9f0d-e31e10d66fb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Converting VIF {"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:2a:33,bridge_name='br-int',has_traffic_filtering=True,id=9bbf8f11-4979-445b-b429-c2b404283afc,network=Network(42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bbf8f11-49') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG os_vif [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:2a:33,bridge_name='br-int',has_traffic_filtering=True,id=9bbf8f11-4979-445b-b429-c2b404283afc,network=Network(42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bbf8f11-49') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bbf8f11-49, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9bbf8f11-49, col_values=(('external_ids', {'iface-id': '9bbf8f11-4979-445b-b429-c2b404283afc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:2a:33', 'vm-uuid': 'a70f4f57-2a18-4489-9f0d-e31e10d66fb0'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:56 user nova-compute[71325]: INFO os_vif [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:2a:33,bridge_name='br-int',has_traffic_filtering=True,id=9bbf8f11-4979-445b-b429-c2b404283afc,network=Network(42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bbf8f11-49')
Apr 13 22:07:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:07:56 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] No VIF found with MAC fa:16:3e:37:2a:33, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:07:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-dedf8eeb-ea0d-403a-94c0-c0aa422293d7 req-790e33aa-8476-4b89-b7a6-4d4dbc2a54c5 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:07:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dedf8eeb-ea0d-403a-94c0-c0aa422293d7 req-790e33aa-8476-4b89-b7a6-4d4dbc2a54c5 service nova] Acquiring lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:07:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dedf8eeb-ea0d-403a-94c0-c0aa422293d7 req-790e33aa-8476-4b89-b7a6-4d4dbc2a54c5 service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:07:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dedf8eeb-ea0d-403a-94c0-c0aa422293d7 req-790e33aa-8476-4b89-b7a6-4d4dbc2a54c5 service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:07:58 user nova-compute[71325]: DEBUG nova.compute.manager [req-dedf8eeb-ea0d-403a-94c0-c0aa422293d7 req-790e33aa-8476-4b89-b7a6-4d4dbc2a54c5 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] No waiting events found dispatching network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:07:58 user nova-compute[71325]: WARNING nova.compute.manager [req-dedf8eeb-ea0d-403a-94c0-c0aa422293d7 req-790e33aa-8476-4b89-b7a6-4d4dbc2a54c5 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received unexpected event network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 22:07:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:07:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:00 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423680.0086224, a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:08:00 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] VM Resumed (Lifecycle Event)
Apr 13 22:08:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:08:00 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:08:00 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Instance spawned successfully.
Apr 13 22:08:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:08:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:08:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:08:00 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:08:00 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423680.0103421, a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:08:00 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] VM Started (Lifecycle Event)
Apr 13 22:08:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:08:00 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:08:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.214s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-57c14e74-029c-4e58-aac2-762e344d6600 req-bbedbe45-cf11-4f56-873b-60a757af3902 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:08:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-57c14e74-029c-4e58-aac2-762e344d6600 req-bbedbe45-cf11-4f56-873b-60a757af3902 service nova] Acquiring lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-57c14e74-029c-4e58-aac2-762e344d6600 req-bbedbe45-cf11-4f56-873b-60a757af3902 service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:00 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-57c14e74-029c-4e58-aac2-762e344d6600 req-bbedbe45-cf11-4f56-873b-60a757af3902 service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:00 user nova-compute[71325]: DEBUG nova.compute.manager [req-57c14e74-029c-4e58-aac2-762e344d6600 req-bbedbe45-cf11-4f56-873b-60a757af3902 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] No waiting events found dispatching network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:08:00 user nova-compute[71325]: WARNING nova.compute.manager [req-57c14e74-029c-4e58-aac2-762e344d6600 req-bbedbe45-cf11-4f56-873b-60a757af3902 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received unexpected event network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc for instance with vm_state active and task_state None.
Apr 13 22:08:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:06 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423671.3230283, 6fbf2022-b069-440f-8513-6d107f0a7180 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:08:06 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] VM Stopped (Lifecycle Event)
Apr 13 22:08:06 user nova-compute[71325]: DEBUG nova.compute.manager [None req-f61882ba-4082-478f-87a7-3e2e8333c9bf None None] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:08:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:08:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:16 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:08:19 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:08:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:08:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:08:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:08:19 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:08:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-562d31e7-21b4-409b-a2e0-ea194bab500a req-10bfbf3b-d88b-49f0-8a94-946693db80b3 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Received event network-changed-7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:08:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-562d31e7-21b4-409b-a2e0-ea194bab500a req-10bfbf3b-d88b-49f0-8a94-946693db80b3 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Refreshing instance network info cache due to event network-changed-7cc730c3-a97b-4fd0-8e8e-25e07a307843. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:08:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-562d31e7-21b4-409b-a2e0-ea194bab500a req-10bfbf3b-d88b-49f0-8a94-946693db80b3 service nova] Acquiring lock "refresh_cache-7741644e-2273-4d75-9b4d-8bf386400b07" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:08:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-562d31e7-21b4-409b-a2e0-ea194bab500a req-10bfbf3b-d88b-49f0-8a94-946693db80b3 service nova] Acquired lock "refresh_cache-7741644e-2273-4d75-9b4d-8bf386400b07" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:08:20 user nova-compute[71325]: DEBUG nova.network.neutron [req-562d31e7-21b4-409b-a2e0-ea194bab500a req-10bfbf3b-d88b-49f0-8a94-946693db80b3 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Refreshing network info cache for port 7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:08:20 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Updating instance_info_cache with network_info: [{"id": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "address": "fa:16:3e:98:81:ee", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832e1c7c-c4", "ovs_interfaceid": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:08:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:08:20 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:08:20 user nova-compute[71325]: DEBUG nova.network.neutron [req-562d31e7-21b4-409b-a2e0-ea194bab500a req-10bfbf3b-d88b-49f0-8a94-946693db80b3 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Updated VIF entry in instance network info cache for port 7cc730c3-a97b-4fd0-8e8e-25e07a307843. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:08:20 user nova-compute[71325]: DEBUG nova.network.neutron [req-562d31e7-21b4-409b-a2e0-ea194bab500a req-10bfbf3b-d88b-49f0-8a94-946693db80b3 service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Updating instance_info_cache with network_info: [{"id": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "address": "fa:16:3e:89:c8:6b", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc730c3-a9", "ovs_interfaceid": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:08:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-562d31e7-21b4-409b-a2e0-ea194bab500a req-10bfbf3b-d88b-49f0-8a94-946693db80b3 service nova] Releasing lock "refresh_cache-7741644e-2273-4d75-9b4d-8bf386400b07" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:08:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:08:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:21 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:08:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:08:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:08:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:08:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:08:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:24 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:08:24 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:08:24 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:08:24 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8135MB free_disk=26.100040435791016GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:08:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "03027926-4eef-4af8-afca-b70f625de6ab" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "03027926-4eef-4af8-afca-b70f625de6ab" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:24 user nova-compute[71325]: DEBUG nova.compute.manager [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Going to confirm migration 2 {{(pid=71325) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Applying migration context for instance 03027926-4eef-4af8-afca-b70f625de6ab as it has an incoming, in-progress migration 3695c41c-55d4-40e7-a150-1984d1dbd2ee. Migration status is confirming {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 22:08:25 user nova-compute[71325]: INFO nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updating resource usage from migration 3695c41c-55d4-40e7-a150-1984d1dbd2ee
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ada4ed22-c00b-47cd-885b-58d7eceff652 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 7741644e-2273-4d75-9b4d-8bf386400b07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Migration 3695c41c-55d4-40e7-a150-1984d1dbd2ee is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 03027926-4eef-4af8-afca-b70f625de6ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquired lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.network.neutron [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.objects.instance [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'info_cache' on Instance uuid 03027926-4eef-4af8-afca-b70f625de6ab {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.network.neutron [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updating instance_info_cache with network_info: [{"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Releasing lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.objects.instance [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'migration_context' on Instance uuid 03027926-4eef-4af8-afca-b70f625de6ab {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:08:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.278s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:26 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Deleted allocation for migration 3695c41c-55d4-40e7-a150-1984d1dbd2ee
Apr 13 22:08:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "03027926-4eef-4af8-afca-b70f625de6ab" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.211s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:27 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:08:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:27 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:08:27 user nova-compute[71325]: INFO nova.compute.claims [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Claim successful on node user
Apr 13 22:08:27 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:08:27 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:08:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:27 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:08:27 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:08:27 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:08:27 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:08:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG nova.policy [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:08:28 user nova-compute[71325]: INFO nova.virt.block_device [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Booting with volume dd3498e9-9800-4320-bd74-8a7f1929465d at /dev/vda
Apr 13 22:08:28 user nova-compute[71325]: DEBUG os_brick.utils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d648ca-0bbe-4282-b23a-73bd464a7544]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae1f866-814b-47f5-8d5c-616a34b2ab75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6397a15-ff80-4492-8f8d-f7a71344dd0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[559e22de-6fd2-4b40-b4ba-2d30434ed991]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:08:28 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d72460a-51f0-4518-a4a7-656182c45f2c]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG os_brick.utils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Updating existing volume attachment record: 155b855d-a49b-4cfa-9ec7-33c92d807c6e {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:08:28 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Successfully created port: 3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:08:29 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Successfully updated port: 3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:08:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "refresh_cache-459ff5ca-7911-4aa8-8cfd-e85cead816a5" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:08:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquired lock "refresh_cache-459ff5ca-7911-4aa8-8cfd-e85cead816a5" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:08:29 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:08:29 user nova-compute[71325]: DEBUG nova.compute.manager [req-bd0382ed-d080-4a12-b93b-721da24f73c1 req-eb71f007-9141-4e08-a740-2992d1336c03 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Received event network-changed-3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:08:29 user nova-compute[71325]: DEBUG nova.compute.manager [req-bd0382ed-d080-4a12-b93b-721da24f73c1 req-eb71f007-9141-4e08-a740-2992d1336c03 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Refreshing instance network info cache due to event network-changed-3b01de56-e932-4de5-9e2f-ab7bc4295528. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:08:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bd0382ed-d080-4a12-b93b-721da24f73c1 req-eb71f007-9141-4e08-a740-2992d1336c03 service nova] Acquiring lock "refresh_cache-459ff5ca-7911-4aa8-8cfd-e85cead816a5" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:08:29 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:08:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:30 user nova-compute[71325]: DEBUG nova.network.neutron [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Updating instance_info_cache with network_info: [{"id": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "address": "fa:16:3e:7f:a2:aa", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b01de56-e9", "ovs_interfaceid": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:08:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Releasing lock "refresh_cache-459ff5ca-7911-4aa8-8cfd-e85cead816a5" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:08:30 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Instance network_info: |[{"id": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "address": "fa:16:3e:7f:a2:aa", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b01de56-e9", "ovs_interfaceid": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:08:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bd0382ed-d080-4a12-b93b-721da24f73c1 req-eb71f007-9141-4e08-a740-2992d1336c03 service nova] Acquired lock "refresh_cache-459ff5ca-7911-4aa8-8cfd-e85cead816a5" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:08:30 user nova-compute[71325]: DEBUG nova.network.neutron [req-bd0382ed-d080-4a12-b93b-721da24f73c1 req-eb71f007-9141-4e08-a740-2992d1336c03 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Refreshing network info cache for port 3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:08:31 user nova-compute[71325]: DEBUG nova.network.neutron [req-bd0382ed-d080-4a12-b93b-721da24f73c1 req-eb71f007-9141-4e08-a740-2992d1336c03 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Updated VIF entry in instance network info cache for port 3b01de56-e932-4de5-9e2f-ab7bc4295528. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:08:31 user nova-compute[71325]: DEBUG nova.network.neutron [req-bd0382ed-d080-4a12-b93b-721da24f73c1 req-eb71f007-9141-4e08-a740-2992d1336c03 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Updating instance_info_cache with network_info: [{"id": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "address": "fa:16:3e:7f:a2:aa", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b01de56-e9", "ovs_interfaceid": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:08:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bd0382ed-d080-4a12-b93b-721da24f73c1 req-eb71f007-9141-4e08-a740-2992d1336c03 service nova] Releasing lock "refresh_cache-459ff5ca-7911-4aa8-8cfd-e85cead816a5" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:08:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:32 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:08:33 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Creating image(s)
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Did not create local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Ensure instance console log exists: /opt/stack/data/nova/instances/459ff5ca-7911-4aa8-8cfd-e85cead816a5/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Start _get_guest_xml network_info=[{"id": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "address": "fa:16:3e:7f:a2:aa", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b01de56-e9", "ovs_interfaceid": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrReziIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '459ff5ca-7911-4aa8-8cfd-e85cead816a5', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd3498e9-9800-4320-bd74-8a7f1929465d', 'serial': 'dd3498e9-9800-4320-bd74-8a7f1929465d'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '155b855d-a49b-4cfa-9ec7-33c92d807c6e', 'guest_format': None, 'volume_type': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:08:33 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:08:33 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrReziIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:08:33 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:08:33 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:08:33 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e776b2-14e0-4461-92a3-d086e173d9cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:08:33 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[26413885-8488-4320-bcd6-bd8e7959add5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d] added
Apr 13 22:08:33 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec9bbdf-caf6-4c0b-9309-dc3bc059ec97]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7081a0f9-518a-412d-889f-739d2cabb618]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrReziIq {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrReziIq" returned: 0 in 0.031s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b29111-ac97-4d7c-bf1f-fe501324950a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FrReziIq'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bdb5c4-307a-4480-833e-d1b4f6dba43f]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[09528021-f54f-4770-b581-5432fdd49033]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:08:33 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:08:33 user nova-compute[71325]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:08:33 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:08:33 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:08:33 user nova-compute[71325]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:08:33 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad10943-7792-48ad-b744-c215bc09e004]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d, portal: 172.16.0.220,3260]
Apr 13 22:08:33 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d, portal: 172.16.0.220,3260] successful.
Apr 13 22:08:33 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1020eb55-64dd-4eba-b13f-ba24f13e930f]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddda66e-aa2d-4464-87da-d85d81cda299]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:08:33 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:08:33 user nova-compute[71325]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:08:33 user nova-compute[71325]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d (non-flash)
Apr 13 22:08:33 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:08:33 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:08:33 user nova-compute[71325]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:08:33 user nova-compute[71325]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d (non-flash)
Apr 13 22:08:33 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f1f631-3a53-4110-96dd-51348f15ce73]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:08:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrReziIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:08:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:08:34 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23365363939633662', 'path': '/dev/sde'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:08:34 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365363939633662', 'path': '/dev/sde'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1525616194',display_name='tempest-TestVolumeBootPattern-server-1525616194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1525616194',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORfhunB7LA94/Vo0IeX5uHg0BK3ZrJIdCSr/QNts93zg201FlS6UuD5bquQQY3opSX8Ui/7/1jLECj4NoRXCObFsyJekLp1y4HjowC79e9IEN0rtSp6qQ2huNvtbuOLUg==',key_name='tempest-TestVolumeBootPattern-949568181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-9ekpw2s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:08:28Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=459ff5ca-7911-4aa8-8cfd-e85cead816a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "address": "fa:16:3e:7f:a2:aa", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b01de56-e9", "ovs_interfaceid": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "address": "fa:16:3e:7f:a2:aa", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b01de56-e9", "ovs_interfaceid": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b01de56-e932-4de5-9e2f-ab7bc4295528,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b01de56-e9') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lazy-loading 'pci_devices' on Instance uuid 459ff5ca-7911-4aa8-8cfd-e85cead816a5 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:08:35 user nova-compute[71325]:   <uuid>459ff5ca-7911-4aa8-8cfd-e85cead816a5</uuid>
Apr 13 22:08:35 user nova-compute[71325]:   <name>instance-0000002b</name>
Apr 13 22:08:35 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:08:35 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:08:35 user nova-compute[71325]:   <metadata>
Apr 13 22:08:35 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:08:35 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:08:35 user nova-compute[71325]:       <nova:name>tempest-TestVolumeBootPattern-server-1525616194</nova:name>
Apr 13 22:08:35 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:08:33</nova:creationTime>
Apr 13 22:08:35 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:08:35 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:08:35 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:08:35 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:08:35 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:08:35 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:08:35 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:08:35 user nova-compute[71325]:       <nova:owner>
Apr 13 22:08:35 user nova-compute[71325]:         <nova:user uuid="50a8a5f433c94e0c9ba4d6ecea37d756">tempest-TestVolumeBootPattern-1335483698-project-member</nova:user>
Apr 13 22:08:35 user nova-compute[71325]:         <nova:project uuid="ad824150d99044c6ab1c7829cbe01de5">tempest-TestVolumeBootPattern-1335483698</nova:project>
Apr 13 22:08:35 user nova-compute[71325]:       </nova:owner>
Apr 13 22:08:35 user nova-compute[71325]:       <nova:ports>
Apr 13 22:08:35 user nova-compute[71325]:         <nova:port uuid="3b01de56-e932-4de5-9e2f-ab7bc4295528">
Apr 13 22:08:35 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 22:08:35 user nova-compute[71325]:         </nova:port>
Apr 13 22:08:35 user nova-compute[71325]:       </nova:ports>
Apr 13 22:08:35 user nova-compute[71325]:     </nova:instance>
Apr 13 22:08:35 user nova-compute[71325]:   </metadata>
Apr 13 22:08:35 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:08:35 user nova-compute[71325]:     <system>
Apr 13 22:08:35 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:08:35 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:08:35 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:08:35 user nova-compute[71325]:       <entry name="serial">459ff5ca-7911-4aa8-8cfd-e85cead816a5</entry>
Apr 13 22:08:35 user nova-compute[71325]:       <entry name="uuid">459ff5ca-7911-4aa8-8cfd-e85cead816a5</entry>
Apr 13 22:08:35 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:08:35 user nova-compute[71325]:     </system>
Apr 13 22:08:35 user nova-compute[71325]:   </sysinfo>
Apr 13 22:08:35 user nova-compute[71325]:   <os>
Apr 13 22:08:35 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:08:35 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:08:35 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:08:35 user nova-compute[71325]:   </os>
Apr 13 22:08:35 user nova-compute[71325]:   <features>
Apr 13 22:08:35 user nova-compute[71325]:     <acpi/>
Apr 13 22:08:35 user nova-compute[71325]:     <apic/>
Apr 13 22:08:35 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:08:35 user nova-compute[71325]:   </features>
Apr 13 22:08:35 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:08:35 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:08:35 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:08:35 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:08:35 user nova-compute[71325]:   </clock>
Apr 13 22:08:35 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:08:35 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:08:35 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:08:35 user nova-compute[71325]:   </cpu>
Apr 13 22:08:35 user nova-compute[71325]:   <devices>
Apr 13 22:08:35 user nova-compute[71325]:     <disk type="block" device="disk">
Apr 13 22:08:35 user nova-compute[71325]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:08:35 user nova-compute[71325]:       <source dev="/dev/sde"/>
Apr 13 22:08:35 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:08:35 user nova-compute[71325]:       <serial>dd3498e9-9800-4320-bd74-8a7f1929465d</serial>
Apr 13 22:08:35 user nova-compute[71325]:     </disk>
Apr 13 22:08:35 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:08:35 user nova-compute[71325]:       <mac address="fa:16:3e:7f:a2:aa"/>
Apr 13 22:08:35 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:08:35 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:08:35 user nova-compute[71325]:       <target dev="tap3b01de56-e9"/>
Apr 13 22:08:35 user nova-compute[71325]:     </interface>
Apr 13 22:08:35 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:08:35 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/459ff5ca-7911-4aa8-8cfd-e85cead816a5/console.log" append="off"/>
Apr 13 22:08:35 user nova-compute[71325]:     </serial>
Apr 13 22:08:35 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:08:35 user nova-compute[71325]:     <video>
Apr 13 22:08:35 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:08:35 user nova-compute[71325]:     </video>
Apr 13 22:08:35 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:08:35 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:08:35 user nova-compute[71325]:     </rng>
Apr 13 22:08:35 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:08:35 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:08:35 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:08:35 user nova-compute[71325]:     </memballoon>
Apr 13 22:08:35 user nova-compute[71325]:   </devices>
Apr 13 22:08:35 user nova-compute[71325]: </domain>
Apr 13 22:08:35 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1525616194',display_name='tempest-TestVolumeBootPattern-server-1525616194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1525616194',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORfhunB7LA94/Vo0IeX5uHg0BK3ZrJIdCSr/QNts93zg201FlS6UuD5bquQQY3opSX8Ui/7/1jLECj4NoRXCObFsyJekLp1y4HjowC79e9IEN0rtSp6qQ2huNvtbuOLUg==',key_name='tempest-TestVolumeBootPattern-949568181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-9ekpw2s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:08:28Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=459ff5ca-7911-4aa8-8cfd-e85cead816a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "address": "fa:16:3e:7f:a2:aa", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b01de56-e9", "ovs_interfaceid": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "address": "fa:16:3e:7f:a2:aa", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b01de56-e9", "ovs_interfaceid": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b01de56-e932-4de5-9e2f-ab7bc4295528,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b01de56-e9') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG os_vif [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b01de56-e932-4de5-9e2f-ab7bc4295528,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b01de56-e9') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b01de56-e9, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b01de56-e9, col_values=(('external_ids', {'iface-id': '3b01de56-e932-4de5-9e2f-ab7bc4295528', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:a2:aa', 'vm-uuid': '459ff5ca-7911-4aa8-8cfd-e85cead816a5'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:35 user nova-compute[71325]: INFO os_vif [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b01de56-e932-4de5-9e2f-ab7bc4295528,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b01de56-e9')
Apr 13 22:08:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] No VIF found with MAC fa:16:3e:7f:a2:aa, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "9b94df42-303b-484a-a778-4089323072ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "9b94df42-303b-484a-a778-4089323072ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:35 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:08:35 user nova-compute[71325]: INFO nova.compute.claims [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Claim successful on node user
Apr 13 22:08:36 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG nova.compute.manager [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG nova.compute.manager [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG nova.network.neutron [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:08:36 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:08:36 user nova-compute[71325]: DEBUG nova.compute.manager [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG nova.compute.manager [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:08:36 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Creating image(s)
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "/opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "/opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG nova.policy [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64bf9d3c42c14ec3b22302b6fe5d52d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c52a86a481f425abf1cb1d75417421e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.170s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk 1073741824" returned: 0 in 0.068s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.144s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:08:36 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:08:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-1e5b9d99-bb17-46d1-87d3-48ae98b871e1 req-9264e1d1-c431-4d84-9b2a-8b8e31410ef0 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Received event network-vif-plugged-3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:08:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1e5b9d99-bb17-46d1-87d3-48ae98b871e1 req-9264e1d1-c431-4d84-9b2a-8b8e31410ef0 service nova] Acquiring lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1e5b9d99-bb17-46d1-87d3-48ae98b871e1 req-9264e1d1-c431-4d84-9b2a-8b8e31410ef0 service nova] Lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1e5b9d99-bb17-46d1-87d3-48ae98b871e1 req-9264e1d1-c431-4d84-9b2a-8b8e31410ef0 service nova] Lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:37 user nova-compute[71325]: DEBUG nova.compute.manager [req-1e5b9d99-bb17-46d1-87d3-48ae98b871e1 req-9264e1d1-c431-4d84-9b2a-8b8e31410ef0 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] No waiting events found dispatching network-vif-plugged-3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:08:37 user nova-compute[71325]: WARNING nova.compute.manager [req-1e5b9d99-bb17-46d1-87d3-48ae98b871e1 req-9264e1d1-c431-4d84-9b2a-8b8e31410ef0 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Received unexpected event network-vif-plugged-3b01de56-e932-4de5-9e2f-ab7bc4295528 for instance with vm_state building and task_state spawning.
Apr 13 22:08:37 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:08:37 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Cannot resize image /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:08:37 user nova-compute[71325]: DEBUG nova.objects.instance [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lazy-loading 'migration_context' on Instance uuid 9b94df42-303b-484a-a778-4089323072ec {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:08:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:08:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Ensure instance console log exists: /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:08:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:37 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:37 user nova-compute[71325]: DEBUG nova.network.neutron [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Successfully created port: 6e8199a3-60b0-4e19-9106-76cc2118a167 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:08:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Successfully updated port: 6e8199a3-60b0-4e19-9106-76cc2118a167 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:08:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "refresh_cache-9b94df42-303b-484a-a778-4089323072ec" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:08:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquired lock "refresh_cache-9b94df42-303b-484a-a778-4089323072ec" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:08:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:08:38 user nova-compute[71325]: DEBUG nova.network.neutron [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:08:38 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423718.7355037, 459ff5ca-7911-4aa8-8cfd-e85cead816a5 => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:08:38 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] VM Resumed (Lifecycle Event)
Apr 13 22:08:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:08:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:08:38 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Instance spawned successfully.
Apr 13 22:08:38 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:08:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Received event network-vif-plugged-3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] Acquiring lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] Lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] Lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] No waiting events found dispatching network-vif-plugged-3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:08:39 user nova-compute[71325]: WARNING nova.compute.manager [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Received unexpected event network-vif-plugged-3b01de56-e932-4de5-9e2f-ab7bc4295528 for instance with vm_state building and task_state spawning.
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] Received event network-changed-6e8199a3-60b0-4e19-9106-76cc2118a167 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] Refreshing instance network info cache due to event network-changed-6e8199a3-60b0-4e19-9106-76cc2118a167. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] Acquiring lock "refresh_cache-9b94df42-303b-484a-a778-4089323072ec" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:08:39 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423718.7373796, 459ff5ca-7911-4aa8-8cfd-e85cead816a5 => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:08:39 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] VM Started (Lifecycle Event)
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:08:39 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.network.neutron [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Updating instance_info_cache with network_info: [{"id": "6e8199a3-60b0-4e19-9106-76cc2118a167", "address": "fa:16:3e:22:e7:df", "network": {"id": "08fd4473-8ec0-42e1-81f9-f4799635112b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1156989076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7c52a86a481f425abf1cb1d75417421e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8199a3-60", "ovs_interfaceid": "6e8199a3-60b0-4e19-9106-76cc2118a167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Releasing lock "refresh_cache-9b94df42-303b-484a-a778-4089323072ec" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Instance network_info: |[{"id": "6e8199a3-60b0-4e19-9106-76cc2118a167", "address": "fa:16:3e:22:e7:df", "network": {"id": "08fd4473-8ec0-42e1-81f9-f4799635112b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1156989076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7c52a86a481f425abf1cb1d75417421e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8199a3-60", "ovs_interfaceid": "6e8199a3-60b0-4e19-9106-76cc2118a167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] Acquired lock "refresh_cache-9b94df42-303b-484a-a778-4089323072ec" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.network.neutron [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] Refreshing network info cache for port 6e8199a3-60b0-4e19-9106-76cc2118a167 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Start _get_guest_xml network_info=[{"id": "6e8199a3-60b0-4e19-9106-76cc2118a167", "address": "fa:16:3e:22:e7:df", "network": {"id": "08fd4473-8ec0-42e1-81f9-f4799635112b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1156989076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7c52a86a481f425abf1cb1d75417421e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8199a3-60", "ovs_interfaceid": "6e8199a3-60b0-4e19-9106-76cc2118a167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:08:39 user nova-compute[71325]: INFO nova.compute.manager [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Took 6.06 seconds to spawn the instance on the hypervisor.
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:08:39 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:08:39 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1227800336',display_name='tempest-VolumesActionsTest-instance-1227800336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1227800336',id=44,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c52a86a481f425abf1cb1d75417421e',ramdisk_id='',reservation_id='r-85mlbqv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-635015448',owner_user_name='tempest-VolumesActionsTest-635015448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:08:36Z,user_data=None,user_id='64bf9d3c42c14ec3b22302b6fe5d52d2',uuid=9b94df42-303b-484a-a778-4089323072ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e8199a3-60b0-4e19-9106-76cc2118a167", "address": "fa:16:3e:22:e7:df", "network": {"id": "08fd4473-8ec0-42e1-81f9-f4799635112b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1156989076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7c52a86a481f425abf1cb1d75417421e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8199a3-60", "ovs_interfaceid": "6e8199a3-60b0-4e19-9106-76cc2118a167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Converting VIF {"id": "6e8199a3-60b0-4e19-9106-76cc2118a167", "address": "fa:16:3e:22:e7:df", "network": {"id": "08fd4473-8ec0-42e1-81f9-f4799635112b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1156989076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7c52a86a481f425abf1cb1d75417421e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8199a3-60", "ovs_interfaceid": "6e8199a3-60b0-4e19-9106-76cc2118a167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e7:df,bridge_name='br-int',has_traffic_filtering=True,id=6e8199a3-60b0-4e19-9106-76cc2118a167,network=Network(08fd4473-8ec0-42e1-81f9-f4799635112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e8199a3-60') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.objects.instance [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b94df42-303b-484a-a778-4089323072ec {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:08:39 user nova-compute[71325]:   <uuid>9b94df42-303b-484a-a778-4089323072ec</uuid>
Apr 13 22:08:39 user nova-compute[71325]:   <name>instance-0000002c</name>
Apr 13 22:08:39 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:08:39 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:08:39 user nova-compute[71325]:   <metadata>
Apr 13 22:08:39 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:08:39 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:08:39 user nova-compute[71325]:       <nova:name>tempest-VolumesActionsTest-instance-1227800336</nova:name>
Apr 13 22:08:39 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:08:39</nova:creationTime>
Apr 13 22:08:39 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:08:39 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:08:39 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:08:39 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:08:39 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:08:39 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:08:39 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:08:39 user nova-compute[71325]:       <nova:owner>
Apr 13 22:08:39 user nova-compute[71325]:         <nova:user uuid="64bf9d3c42c14ec3b22302b6fe5d52d2">tempest-VolumesActionsTest-635015448-project-member</nova:user>
Apr 13 22:08:39 user nova-compute[71325]:         <nova:project uuid="7c52a86a481f425abf1cb1d75417421e">tempest-VolumesActionsTest-635015448</nova:project>
Apr 13 22:08:39 user nova-compute[71325]:       </nova:owner>
Apr 13 22:08:39 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 22:08:39 user nova-compute[71325]:       <nova:ports>
Apr 13 22:08:39 user nova-compute[71325]:         <nova:port uuid="6e8199a3-60b0-4e19-9106-76cc2118a167">
Apr 13 22:08:39 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 22:08:39 user nova-compute[71325]:         </nova:port>
Apr 13 22:08:39 user nova-compute[71325]:       </nova:ports>
Apr 13 22:08:39 user nova-compute[71325]:     </nova:instance>
Apr 13 22:08:39 user nova-compute[71325]:   </metadata>
Apr 13 22:08:39 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:08:39 user nova-compute[71325]:     <system>
Apr 13 22:08:39 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:08:39 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:08:39 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:08:39 user nova-compute[71325]:       <entry name="serial">9b94df42-303b-484a-a778-4089323072ec</entry>
Apr 13 22:08:39 user nova-compute[71325]:       <entry name="uuid">9b94df42-303b-484a-a778-4089323072ec</entry>
Apr 13 22:08:39 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:08:39 user nova-compute[71325]:     </system>
Apr 13 22:08:39 user nova-compute[71325]:   </sysinfo>
Apr 13 22:08:39 user nova-compute[71325]:   <os>
Apr 13 22:08:39 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:08:39 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:08:39 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:08:39 user nova-compute[71325]:   </os>
Apr 13 22:08:39 user nova-compute[71325]:   <features>
Apr 13 22:08:39 user nova-compute[71325]:     <acpi/>
Apr 13 22:08:39 user nova-compute[71325]:     <apic/>
Apr 13 22:08:39 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:08:39 user nova-compute[71325]:   </features>
Apr 13 22:08:39 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:08:39 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:08:39 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:08:39 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:08:39 user nova-compute[71325]:   </clock>
Apr 13 22:08:39 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:08:39 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:08:39 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:08:39 user nova-compute[71325]:   </cpu>
Apr 13 22:08:39 user nova-compute[71325]:   <devices>
Apr 13 22:08:39 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 22:08:39 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:08:39 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk"/>
Apr 13 22:08:39 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:08:39 user nova-compute[71325]:     </disk>
Apr 13 22:08:39 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:08:39 user nova-compute[71325]:       <mac address="fa:16:3e:22:e7:df"/>
Apr 13 22:08:39 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:08:39 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:08:39 user nova-compute[71325]:       <target dev="tap6e8199a3-60"/>
Apr 13 22:08:39 user nova-compute[71325]:     </interface>
Apr 13 22:08:39 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:08:39 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/console.log" append="off"/>
Apr 13 22:08:39 user nova-compute[71325]:     </serial>
Apr 13 22:08:39 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:08:39 user nova-compute[71325]:     <video>
Apr 13 22:08:39 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:08:39 user nova-compute[71325]:     </video>
Apr 13 22:08:39 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:08:39 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:08:39 user nova-compute[71325]:     </rng>
Apr 13 22:08:39 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:08:39 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:08:39 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:08:39 user nova-compute[71325]:     </memballoon>
Apr 13 22:08:39 user nova-compute[71325]:   </devices>
Apr 13 22:08:39 user nova-compute[71325]: </domain>
Apr 13 22:08:39 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1227800336',display_name='tempest-VolumesActionsTest-instance-1227800336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1227800336',id=44,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c52a86a481f425abf1cb1d75417421e',ramdisk_id='',reservation_id='r-85mlbqv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-635015448',owner_user_name='tempest-VolumesActionsTest-635015448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:08:36Z,user_data=None,user_id='64bf9d3c42c14ec3b22302b6fe5d52d2',uuid=9b94df42-303b-484a-a778-4089323072ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e8199a3-60b0-4e19-9106-76cc2118a167", "address": "fa:16:3e:22:e7:df", "network": {"id": "08fd4473-8ec0-42e1-81f9-f4799635112b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1156989076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7c52a86a481f425abf1cb1d75417421e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8199a3-60", "ovs_interfaceid": "6e8199a3-60b0-4e19-9106-76cc2118a167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Converting VIF {"id": "6e8199a3-60b0-4e19-9106-76cc2118a167", "address": "fa:16:3e:22:e7:df", "network": {"id": "08fd4473-8ec0-42e1-81f9-f4799635112b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1156989076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7c52a86a481f425abf1cb1d75417421e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8199a3-60", "ovs_interfaceid": "6e8199a3-60b0-4e19-9106-76cc2118a167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e7:df,bridge_name='br-int',has_traffic_filtering=True,id=6e8199a3-60b0-4e19-9106-76cc2118a167,network=Network(08fd4473-8ec0-42e1-81f9-f4799635112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e8199a3-60') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG os_vif [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e7:df,bridge_name='br-int',has_traffic_filtering=True,id=6e8199a3-60b0-4e19-9106-76cc2118a167,network=Network(08fd4473-8ec0-42e1-81f9-f4799635112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e8199a3-60') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e8199a3-60, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e8199a3-60, col_values=(('external_ids', {'iface-id': '6e8199a3-60b0-4e19-9106-76cc2118a167', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:e7:df', 'vm-uuid': '9b94df42-303b-484a-a778-4089323072ec'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:08:39 user nova-compute[71325]: INFO nova.compute.manager [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Took 11.95 seconds to build instance.
Apr 13 22:08:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:39 user nova-compute[71325]: INFO os_vif [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e7:df,bridge_name='br-int',has_traffic_filtering=True,id=6e8199a3-60b0-4e19-9106-76cc2118a167,network=Network(08fd4473-8ec0-42e1-81f9-f4799635112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e8199a3-60')
Apr 13 22:08:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.046s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] No VIF found with MAC fa:16:3e:22:e7:df, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.network.neutron [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] Updated VIF entry in instance network info cache for port 6e8199a3-60b0-4e19-9106-76cc2118a167. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG nova.network.neutron [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] Updating instance_info_cache with network_info: [{"id": "6e8199a3-60b0-4e19-9106-76cc2118a167", "address": "fa:16:3e:22:e7:df", "network": {"id": "08fd4473-8ec0-42e1-81f9-f4799635112b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1156989076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7c52a86a481f425abf1cb1d75417421e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8199a3-60", "ovs_interfaceid": "6e8199a3-60b0-4e19-9106-76cc2118a167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:08:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] Releasing lock "refresh_cache-9b94df42-303b-484a-a778-4089323072ec" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:08:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-5ff8ff74-e9eb-46af-bffb-babb117e0b4b req-5427847d-27dd-4ad1-ba3a-04bc72260f31 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] Received event network-vif-plugged-6e8199a3-60b0-4e19-9106-76cc2118a167 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5ff8ff74-e9eb-46af-bffb-babb117e0b4b req-5427847d-27dd-4ad1-ba3a-04bc72260f31 service nova] Acquiring lock "9b94df42-303b-484a-a778-4089323072ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5ff8ff74-e9eb-46af-bffb-babb117e0b4b req-5427847d-27dd-4ad1-ba3a-04bc72260f31 service nova] Lock "9b94df42-303b-484a-a778-4089323072ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5ff8ff74-e9eb-46af-bffb-babb117e0b4b req-5427847d-27dd-4ad1-ba3a-04bc72260f31 service nova] Lock "9b94df42-303b-484a-a778-4089323072ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-5ff8ff74-e9eb-46af-bffb-babb117e0b4b req-5427847d-27dd-4ad1-ba3a-04bc72260f31 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] No waiting events found dispatching network-vif-plugged-6e8199a3-60b0-4e19-9106-76cc2118a167 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:08:41 user nova-compute[71325]: WARNING nova.compute.manager [req-5ff8ff74-e9eb-46af-bffb-babb117e0b4b req-5427847d-27dd-4ad1-ba3a-04bc72260f31 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] Received unexpected event network-vif-plugged-6e8199a3-60b0-4e19-9106-76cc2118a167 for instance with vm_state building and task_state spawning.
Apr 13 22:08:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:41 user nova-compute[71325]: INFO nova.compute.manager [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Terminating instance
Apr 13 22:08:41 user nova-compute[71325]: DEBUG nova.compute.manager [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-4d8cb20e-5c08-4315-a522-ec653a1b9e63 req-82240141-bf4d-4995-8bf1-f0634ae035c7 service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Received event network-vif-unplugged-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4d8cb20e-5c08-4315-a522-ec653a1b9e63 req-82240141-bf4d-4995-8bf1-f0634ae035c7 service nova] Acquiring lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4d8cb20e-5c08-4315-a522-ec653a1b9e63 req-82240141-bf4d-4995-8bf1-f0634ae035c7 service nova] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-4d8cb20e-5c08-4315-a522-ec653a1b9e63 req-82240141-bf4d-4995-8bf1-f0634ae035c7 service nova] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-4d8cb20e-5c08-4315-a522-ec653a1b9e63 req-82240141-bf4d-4995-8bf1-f0634ae035c7 service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] No waiting events found dispatching network-vif-unplugged-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:08:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-4d8cb20e-5c08-4315-a522-ec653a1b9e63 req-82240141-bf4d-4995-8bf1-f0634ae035c7 service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Received event network-vif-unplugged-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:08:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Instance destroyed successfully.
Apr 13 22:08:42 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'resources' on Instance uuid b5ce77dc-eda4-4b96-8d61-2297d986f3ee {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:08:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:49:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1503190655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1503190655',id=16,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:49:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11a30fba887e4114be856d26b47a8e55',ramdisk_id='',reservation_id='r-0ya09mva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-33854562',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:51:01Z,user_data=None,user_id='0ab740920cac4befac62a72f7ce5a817',uuid=b5ce77dc-eda4-4b96-8d61-2297d986f3ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "address": "fa:16:3e:c3:11:10", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922fdd9d-6e", "ovs_interfaceid": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:08:42 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converting VIF {"id": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "address": "fa:16:3e:c3:11:10", "network": {"id": "5f022439-52f7-4c06-a4f9-6943fddcd352", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1607606353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11a30fba887e4114be856d26b47a8e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922fdd9d-6e", "ovs_interfaceid": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:08:42 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:11:10,bridge_name='br-int',has_traffic_filtering=True,id=922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922fdd9d-6e') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:08:42 user nova-compute[71325]: DEBUG os_vif [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:11:10,bridge_name='br-int',has_traffic_filtering=True,id=922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922fdd9d-6e') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:08:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap922fdd9d-6e, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:08:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:08:42 user nova-compute[71325]: INFO os_vif [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:11:10,bridge_name='br-int',has_traffic_filtering=True,id=922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec,network=Network(5f022439-52f7-4c06-a4f9-6943fddcd352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922fdd9d-6e')
Apr 13 22:08:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Deleting instance files /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee_del
Apr 13 22:08:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Deletion of /opt/stack/data/nova/instances/b5ce77dc-eda4-4b96-8d61-2297d986f3ee_del complete
Apr 13 22:08:42 user nova-compute[71325]: INFO nova.compute.manager [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 22:08:42 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:08:42 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:08:42 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:08:42 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:08:42 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Took 0.47 seconds to deallocate network for instance.
Apr 13 22:08:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:43 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Deleted allocations for instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423723.2003984, 9b94df42-303b-484a-a778-4089323072ec => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:08:43 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9b94df42-303b-484a-a778-4089323072ec] VM Resumed (Lifecycle Event)
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:08:43 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 9b94df42-303b-484a-a778-4089323072ec] Instance spawned successfully.
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9b94df42-303b-484a-a778-4089323072ec] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.922s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9b94df42-303b-484a-a778-4089323072ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-8e68e9e5-6b90-4979-a18b-35863ff3f455 req-ddedc705-ba23-4e05-9d62-addffdf98a97 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] Received event network-vif-plugged-6e8199a3-60b0-4e19-9106-76cc2118a167 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8e68e9e5-6b90-4979-a18b-35863ff3f455 req-ddedc705-ba23-4e05-9d62-addffdf98a97 service nova] Acquiring lock "9b94df42-303b-484a-a778-4089323072ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8e68e9e5-6b90-4979-a18b-35863ff3f455 req-ddedc705-ba23-4e05-9d62-addffdf98a97 service nova] Lock "9b94df42-303b-484a-a778-4089323072ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-8e68e9e5-6b90-4979-a18b-35863ff3f455 req-ddedc705-ba23-4e05-9d62-addffdf98a97 service nova] Lock "9b94df42-303b-484a-a778-4089323072ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-8e68e9e5-6b90-4979-a18b-35863ff3f455 req-ddedc705-ba23-4e05-9d62-addffdf98a97 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] No waiting events found dispatching network-vif-plugged-6e8199a3-60b0-4e19-9106-76cc2118a167 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:08:43 user nova-compute[71325]: WARNING nova.compute.manager [req-8e68e9e5-6b90-4979-a18b-35863ff3f455 req-ddedc705-ba23-4e05-9d62-addffdf98a97 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] Received unexpected event network-vif-plugged-6e8199a3-60b0-4e19-9106-76cc2118a167 for instance with vm_state building and task_state spawning.
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-8e68e9e5-6b90-4979-a18b-35863ff3f455 req-ddedc705-ba23-4e05-9d62-addffdf98a97 service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Received event network-vif-deleted-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:08:43 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9b94df42-303b-484a-a778-4089323072ec] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423723.20227, 9b94df42-303b-484a-a778-4089323072ec => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:08:43 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9b94df42-303b-484a-a778-4089323072ec] VM Started (Lifecycle Event)
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9b94df42-303b-484a-a778-4089323072ec] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9b94df42-303b-484a-a778-4089323072ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:08:43 user nova-compute[71325]: INFO nova.compute.manager [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Took 7.00 seconds to spawn the instance on the hypervisor.
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:08:43 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 9b94df42-303b-484a-a778-4089323072ec] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:08:43 user nova-compute[71325]: INFO nova.compute.manager [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Took 7.63 seconds to build instance.
Apr 13 22:08:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "9b94df42-303b-484a-a778-4089323072ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.715s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-25aa5cda-d259-4216-8921-4e8c002a5823 req-e9918570-31d2-4059-bbd8-ad6603da7e9c service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Received event network-vif-plugged-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-25aa5cda-d259-4216-8921-4e8c002a5823 req-e9918570-31d2-4059-bbd8-ad6603da7e9c service nova] Acquiring lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-25aa5cda-d259-4216-8921-4e8c002a5823 req-e9918570-31d2-4059-bbd8-ad6603da7e9c service nova] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-25aa5cda-d259-4216-8921-4e8c002a5823 req-e9918570-31d2-4059-bbd8-ad6603da7e9c service nova] Lock "b5ce77dc-eda4-4b96-8d61-2297d986f3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:08:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-25aa5cda-d259-4216-8921-4e8c002a5823 req-e9918570-31d2-4059-bbd8-ad6603da7e9c service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] No waiting events found dispatching network-vif-plugged-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:08:43 user nova-compute[71325]: WARNING nova.compute.manager [req-25aa5cda-d259-4216-8921-4e8c002a5823 req-e9918570-31d2-4059-bbd8-ad6603da7e9c service nova] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Received unexpected event network-vif-plugged-922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec for instance with vm_state deleted and task_state None.
Apr 13 22:08:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:08:57 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423722.1350152, b5ce77dc-eda4-4b96-8d61-2297d986f3ee => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:08:57 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] VM Stopped (Lifecycle Event)
Apr 13 22:08:57 user nova-compute[71325]: DEBUG nova.compute.manager [None req-d2a4323e-9d41-46c6-b165-ade849f2a7d3 None None] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:08:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:02 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:12 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:09:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:17 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:09:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:20 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:09:20 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:09:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:09:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:09:20 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:09:21 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updating instance_info_cache with network_info: [{"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:09:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:09:21 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:09:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:22 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:09:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:09:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:09:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:09:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:09:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:09:23 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:09:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:09:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:09:23 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:09:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:09:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:09:23 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:09:24 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:09:24 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:09:24 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8127MB free_disk=26.161327362060547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ada4ed22-c00b-47cd-885b-58d7eceff652 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 7741644e-2273-4d75-9b4d-8bf386400b07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 03027926-4eef-4af8-afca-b70f625de6ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 9b94df42-303b-484a-a778-4089323072ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:09:24 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:09:25 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:09:25 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:09:25 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:09:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:09:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:09:30 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:09:30 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:09:30 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:09:30 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:09:30 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:09:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:09:32 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:09:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-32327f42-bb18-4d0c-ba23-4c442cb2197f req-7c99c1f8-c07c-4420-ac9d-1dff36074f69 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-changed-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:09:38 user nova-compute[71325]: DEBUG nova.compute.manager [req-32327f42-bb18-4d0c-ba23-4c442cb2197f req-7c99c1f8-c07c-4420-ac9d-1dff36074f69 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Refreshing instance network info cache due to event network-changed-9bbf8f11-4979-445b-b429-c2b404283afc. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:09:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-32327f42-bb18-4d0c-ba23-4c442cb2197f req-7c99c1f8-c07c-4420-ac9d-1dff36074f69 service nova] Acquiring lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:09:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-32327f42-bb18-4d0c-ba23-4c442cb2197f req-7c99c1f8-c07c-4420-ac9d-1dff36074f69 service nova] Acquired lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:09:38 user nova-compute[71325]: DEBUG nova.network.neutron [req-32327f42-bb18-4d0c-ba23-4c442cb2197f req-7c99c1f8-c07c-4420-ac9d-1dff36074f69 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Refreshing network info cache for port 9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:09:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:09:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:09:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:09:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:09:38 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:09:38 user nova-compute[71325]: INFO nova.compute.manager [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Terminating instance
Apr 13 22:09:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-22f59591-3ec3-4fc4-96b1-83bec14400ab req-27e3fe59-5759-4930-bf2e-9994cca98e7d service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-vif-unplugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-22f59591-3ec3-4fc4-96b1-83bec14400ab req-27e3fe59-5759-4930-bf2e-9994cca98e7d service nova] Acquiring lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-22f59591-3ec3-4fc4-96b1-83bec14400ab req-27e3fe59-5759-4930-bf2e-9994cca98e7d service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-22f59591-3ec3-4fc4-96b1-83bec14400ab req-27e3fe59-5759-4930-bf2e-9994cca98e7d service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-22f59591-3ec3-4fc4-96b1-83bec14400ab req-27e3fe59-5759-4930-bf2e-9994cca98e7d service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] No waiting events found dispatching network-vif-unplugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG nova.compute.manager [req-22f59591-3ec3-4fc4-96b1-83bec14400ab req-27e3fe59-5759-4930-bf2e-9994cca98e7d service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-vif-unplugged-9bbf8f11-4979-445b-b429-c2b404283afc for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG nova.network.neutron [req-32327f42-bb18-4d0c-ba23-4c442cb2197f req-7c99c1f8-c07c-4420-ac9d-1dff36074f69 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updated VIF entry in instance network info cache for port 9bbf8f11-4979-445b-b429-c2b404283afc. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG nova.network.neutron [req-32327f42-bb18-4d0c-ba23-4c442cb2197f req-7c99c1f8-c07c-4420-ac9d-1dff36074f69 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updating instance_info_cache with network_info: [{"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-32327f42-bb18-4d0c-ba23-4c442cb2197f req-7c99c1f8-c07c-4420-ac9d-1dff36074f69 service nova] Releasing lock "refresh_cache-a70f4f57-2a18-4489-9f0d-e31e10d66fb0" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:09:39 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Instance destroyed successfully.
Apr 13 22:09:39 user nova-compute[71325]: DEBUG nova.objects.instance [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lazy-loading 'resources' on Instance uuid a70f4f57-2a18-4489-9f0d-e31e10d66fb0 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T22:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1022673409',display_name='tempest-TestShelveInstance-server-1022673409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1022673409',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApLEuuj6KeDDETqj63aLVZwzI0AEs6gs5+edRAA35t7ojDda06wiLqmdjlWHC2bAnnQxBdroXp1ByYUE2HG9fvtYqO42TNErRms80pT+WCt4ra5LjATp2OXAxx0BUru0w==',key_name='tempest-TestShelveInstance-299000327',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:08:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f16c57e44d2f456cab919015f4b9bb4b',ramdisk_id='',reservation_id='r-29a2f5a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1496514884',owner_user_name='tempest-TestShelveInstance-1496514884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:08:00Z,user_data=None,user_id='c8ba9f99764b4e61ac0ed632000fc672',uuid=a70f4f57-2a18-4489-9f0d-e31e10d66fb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Converting VIF {"id": "9bbf8f11-4979-445b-b429-c2b404283afc", "address": "fa:16:3e:37:2a:33", "network": {"id": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1814506499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f16c57e44d2f456cab919015f4b9bb4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bbf8f11-49", "ovs_interfaceid": "9bbf8f11-4979-445b-b429-c2b404283afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:2a:33,bridge_name='br-int',has_traffic_filtering=True,id=9bbf8f11-4979-445b-b429-c2b404283afc,network=Network(42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bbf8f11-49') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG os_vif [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:2a:33,bridge_name='br-int',has_traffic_filtering=True,id=9bbf8f11-4979-445b-b429-c2b404283afc,network=Network(42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bbf8f11-49') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bbf8f11-49, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:09:39 user nova-compute[71325]: INFO os_vif [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:2a:33,bridge_name='br-int',has_traffic_filtering=True,id=9bbf8f11-4979-445b-b429-c2b404283afc,network=Network(42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bbf8f11-49')
Apr 13 22:09:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvFlQGDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:09:39 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:09:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[523cb4b0-d5fa-4db4-8340-1fd86ffe8729]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:09:39 user nova-compute[71325]: No targets found.
Apr 13 22:09:39 user nova-compute[71325]: iSNS:
Apr 13 22:09:39 user nova-compute[71325]: No targets found.
Apr 13 22:09:39 user nova-compute[71325]: STATIC:
Apr 13 22:09:39 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f
Apr 13 22:09:39 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:09:39 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:09:39 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d
Apr 13 22:09:39 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:09:39 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:09:39 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a
Apr 13 22:09:39 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:09:39 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:09:39 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772
Apr 13 22:09:39 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:09:39 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:09:39 user nova-compute[71325]: FIRMWARE:
Apr 13 22:09:39 user nova-compute[71325]: No targets found.
Apr 13 22:09:39 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:09:39 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:09:39 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8622f0a8-c509-4ae6-9cb9-cf1ca715b380]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97f2a35-5da0-4cdd-8403-ea143125af5e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:09:39 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:09:39 user nova-compute[71325]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:09:39 user nova-compute[71325]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d (non-flash)
Apr 13 22:09:39 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:09:39 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:09:39 user nova-compute[71325]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a (non-flash)
Apr 13 22:09:39 user nova-compute[71325]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d (non-flash)
Apr 13 22:09:39 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7d52050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a'): ({'sdd'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Removing single pathed devices sdd {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf39a17-a812-4807-a415-b70268fdc594]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c4fa57-9733-4414-8a35-c4304546fb22]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Flushing IO for device /dev/sdd {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[291f8453-5ce9-429b-a91e-0cd0e594d78d]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:09:39 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.065s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[914b2d36-693d-48ed-96b3-b44ffedea6fe]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] SCSI volumes sdd have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5ed990-1c18-4895-984d-87dbc64e5179]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde80626-d0e2-4825-8807-28ff9fd84fcf]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260]
Apr 13 22:09:40 user nova-compute[71325]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a, portal: 172.16.0.220,3260] successful.
Apr 13 22:09:40 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23dc11c8-0976-4037-a188-9067c88d8f0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ffcb43-8a95-4846-a556-bb9825553e03]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] <== disconnect_volume: return (334ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:09:40 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Deleting instance files /opt/stack/data/nova/instances/a70f4f57-2a18-4489-9f0d-e31e10d66fb0_del
Apr 13 22:09:40 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Deletion of /opt/stack/data/nova/instances/a70f4f57-2a18-4489-9f0d-e31e10d66fb0_del complete
Apr 13 22:09:40 user nova-compute[71325]: INFO nova.compute.manager [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Took 1.32 seconds to destroy the instance on the hypervisor.
Apr 13 22:09:40 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:40 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:09:40 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Took 0.47 seconds to deallocate network for instance.
Apr 13 22:09:40 user nova-compute[71325]: DEBUG nova.compute.manager [req-9a8d076b-fc1a-4a8d-8144-641d0b26ab00 req-a425e74a-b0cd-4d3c-9f75-036112b5c066 service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-vif-deleted-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:09:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-c6948651-8023-405b-9534-da3a796c5093 req-96f65d0d-201e-4dd7-b1b1-733e9d3a007f service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received event network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:09:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c6948651-8023-405b-9534-da3a796c5093 req-96f65d0d-201e-4dd7-b1b1-733e9d3a007f service nova] Acquiring lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:09:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c6948651-8023-405b-9534-da3a796c5093 req-96f65d0d-201e-4dd7-b1b1-733e9d3a007f service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:09:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c6948651-8023-405b-9534-da3a796c5093 req-96f65d0d-201e-4dd7-b1b1-733e9d3a007f service nova] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:09:41 user nova-compute[71325]: DEBUG nova.compute.manager [req-c6948651-8023-405b-9534-da3a796c5093 req-96f65d0d-201e-4dd7-b1b1-733e9d3a007f service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] No waiting events found dispatching network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:09:41 user nova-compute[71325]: WARNING nova.compute.manager [req-c6948651-8023-405b-9534-da3a796c5093 req-96f65d0d-201e-4dd7-b1b1-733e9d3a007f service nova] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Received unexpected event network-vif-plugged-9bbf8f11-4979-445b-b429-c2b404283afc for instance with vm_state active and task_state deleting.
Apr 13 22:09:41 user nova-compute[71325]: INFO nova.compute.manager [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Took 0.76 seconds to detach 1 volumes for instance.
Apr 13 22:09:41 user nova-compute[71325]: DEBUG nova.compute.manager [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Deleting volume: 23dc11c8-0976-4037-a188-9067c88d8f0a {{(pid=71325) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 22:09:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:09:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:09:41 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:09:41 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:09:41 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:09:41 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Deleted allocations for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0
Apr 13 22:09:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "a70f4f57-2a18-4489-9f0d-e31e10d66fb0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.056s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:09:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:09:54 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423779.7459779, a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:09:54 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] VM Stopped (Lifecycle Event)
Apr 13 22:09:54 user nova-compute[71325]: DEBUG nova.compute.manager [None req-56eea1bd-f8de-478d-953d-9e628674dd6d None None] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:09:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:09:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:09:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:09:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:09:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:09:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:10:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:10:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:10:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:10:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:10:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:15 user nova-compute[71325]: INFO nova.compute.manager [None req-f0c28a06-02d2-4dec-a39e-8a3998ad24d5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Get console output
Apr 13 22:10:15 user nova-compute[71325]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 13 22:10:17 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:10:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-e841ba24-6549-4e3d-bc71-213535122e50 req-4d4fadb4-3662-437b-943b-e473fb699f32 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Received event network-changed-3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:10:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-e841ba24-6549-4e3d-bc71-213535122e50 req-4d4fadb4-3662-437b-943b-e473fb699f32 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Refreshing instance network info cache due to event network-changed-3b01de56-e932-4de5-9e2f-ab7bc4295528. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:10:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e841ba24-6549-4e3d-bc71-213535122e50 req-4d4fadb4-3662-437b-943b-e473fb699f32 service nova] Acquiring lock "refresh_cache-459ff5ca-7911-4aa8-8cfd-e85cead816a5" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:10:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e841ba24-6549-4e3d-bc71-213535122e50 req-4d4fadb4-3662-437b-943b-e473fb699f32 service nova] Acquired lock "refresh_cache-459ff5ca-7911-4aa8-8cfd-e85cead816a5" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:10:18 user nova-compute[71325]: DEBUG nova.network.neutron [req-e841ba24-6549-4e3d-bc71-213535122e50 req-4d4fadb4-3662-437b-943b-e473fb699f32 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Refreshing network info cache for port 3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG nova.network.neutron [req-e841ba24-6549-4e3d-bc71-213535122e50 req-4d4fadb4-3662-437b-943b-e473fb699f32 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Updated VIF entry in instance network info cache for port 3b01de56-e932-4de5-9e2f-ab7bc4295528. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG nova.network.neutron [req-e841ba24-6549-4e3d-bc71-213535122e50 req-4d4fadb4-3662-437b-943b-e473fb699f32 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Updating instance_info_cache with network_info: [{"id": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "address": "fa:16:3e:7f:a2:aa", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b01de56-e9", "ovs_interfaceid": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e841ba24-6549-4e3d-bc71-213535122e50 req-4d4fadb4-3662-437b-943b-e473fb699f32 service nova] Releasing lock "refresh_cache-459ff5ca-7911-4aa8-8cfd-e85cead816a5" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-e665110f-34eb-4404-a405-d7be8386bb87 req-a97f1f30-f18d-4078-bf06-622d662e0a16 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Received event network-changed-3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG nova.compute.manager [req-e665110f-34eb-4404-a405-d7be8386bb87 req-a97f1f30-f18d-4078-bf06-622d662e0a16 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Refreshing instance network info cache due to event network-changed-3b01de56-e932-4de5-9e2f-ab7bc4295528. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e665110f-34eb-4404-a405-d7be8386bb87 req-a97f1f30-f18d-4078-bf06-622d662e0a16 service nova] Acquiring lock "refresh_cache-459ff5ca-7911-4aa8-8cfd-e85cead816a5" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e665110f-34eb-4404-a405-d7be8386bb87 req-a97f1f30-f18d-4078-bf06-622d662e0a16 service nova] Acquired lock "refresh_cache-459ff5ca-7911-4aa8-8cfd-e85cead816a5" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG nova.network.neutron [req-e665110f-34eb-4404-a405-d7be8386bb87 req-a97f1f30-f18d-4078-bf06-622d662e0a16 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Refreshing network info cache for port 3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:10:19 user nova-compute[71325]: INFO nova.compute.manager [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Terminating instance
Apr 13 22:10:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-c05ad9d0-d9e8-4434-8920-03fe532e54a6 req-8f988379-4df3-4a47-bc86-744f153258c2 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Received event network-vif-unplugged-3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c05ad9d0-d9e8-4434-8920-03fe532e54a6 req-8f988379-4df3-4a47-bc86-744f153258c2 service nova] Acquiring lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c05ad9d0-d9e8-4434-8920-03fe532e54a6 req-8f988379-4df3-4a47-bc86-744f153258c2 service nova] Lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c05ad9d0-d9e8-4434-8920-03fe532e54a6 req-8f988379-4df3-4a47-bc86-744f153258c2 service nova] Lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-c05ad9d0-d9e8-4434-8920-03fe532e54a6 req-8f988379-4df3-4a47-bc86-744f153258c2 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] No waiting events found dispatching network-vif-unplugged-3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-c05ad9d0-d9e8-4434-8920-03fe532e54a6 req-8f988379-4df3-4a47-bc86-744f153258c2 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Received event network-vif-unplugged-3b01de56-e932-4de5-9e2f-ab7bc4295528 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:10:20 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Instance destroyed successfully.
Apr 13 22:10:20 user nova-compute[71325]: DEBUG nova.objects.instance [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lazy-loading 'resources' on Instance uuid 459ff5ca-7911-4aa8-8cfd-e85cead816a5 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1525616194',display_name='tempest-TestVolumeBootPattern-server-1525616194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1525616194',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORfhunB7LA94/Vo0IeX5uHg0BK3ZrJIdCSr/QNts93zg201FlS6UuD5bquQQY3opSX8Ui/7/1jLECj4NoRXCObFsyJekLp1y4HjowC79e9IEN0rtSp6qQ2huNvtbuOLUg==',key_name='tempest-TestVolumeBootPattern-949568181',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:08:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-9ekpw2s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:08:39Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=459ff5ca-7911-4aa8-8cfd-e85cead816a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "address": "fa:16:3e:7f:a2:aa", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b01de56-e9", "ovs_interfaceid": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "address": "fa:16:3e:7f:a2:aa", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b01de56-e9", "ovs_interfaceid": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a2:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b01de56-e932-4de5-9e2f-ab7bc4295528,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b01de56-e9') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_vif [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a2:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b01de56-e932-4de5-9e2f-ab7bc4295528,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b01de56-e9') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b01de56-e9, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:10:20 user nova-compute[71325]: INFO os_vif [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a2:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b01de56-e932-4de5-9e2f-ab7bc4295528,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b01de56-e9')
Apr 13 22:10:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrReziIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:10:20 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4d16a4-2afa-4981-b79a-d1eb80696401]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:10:20 user nova-compute[71325]: No targets found.
Apr 13 22:10:20 user nova-compute[71325]: iSNS:
Apr 13 22:10:20 user nova-compute[71325]: No targets found.
Apr 13 22:10:20 user nova-compute[71325]: STATIC:
Apr 13 22:10:20 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f
Apr 13 22:10:20 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:10:20 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:10:20 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d
Apr 13 22:10:20 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:10:20 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:10:20 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772
Apr 13 22:10:20 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:10:20 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:10:20 user nova-compute[71325]: FIRMWARE:
Apr 13 22:10:20 user nova-compute[71325]: No targets found.
Apr 13 22:10:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:10:20 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:10:20 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4702d554-3587-4c26-bbc3-b92ade3b6c2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e47084d-23c3-4dd4-88f9-35b764b80449]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:10:20 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:10:20 user nova-compute[71325]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d (non-flash)
Apr 13 22:10:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:10:20 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:10:20 user nova-compute[71325]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d (non-flash)
Apr 13 22:10:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7d509d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d'): ({'sde'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Removing single pathed devices sde {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd33e57-f149-44be-ad7d-fa96fe232253]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[90160564-951a-408a-948f-4b9bac6d7bee]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flushing IO for device /dev/sde {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3a48d5-5a38-42ef-b364-365338120e80]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae87044-1357-454d-b380-4e8eeb1d2e61]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] SCSI volumes sde have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_cb002c3d', '/dev/disk/by-id/scsi-23365363939633662', '/dev/disk/by-id/scsi-1SCST_BIOcb002c3d-3e699c6b8f8f8534') {{(pid=82476) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[85014e00-25b0-4954-b530-893d76e021eb]: (4, None) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b773d3-840f-4b00-986b-d2210f9b1491]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b862699a-6f18-4b48-a98e-af6895a8ad5b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d, portal: 172.16.0.220,3260]
Apr 13 22:10:20 user nova-compute[71325]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d, portal: 172.16.0.220,3260] successful.
Apr 13 22:10:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG nova.network.neutron [req-e665110f-34eb-4404-a405-d7be8386bb87 req-a97f1f30-f18d-4078-bf06-622d662e0a16 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Updated VIF entry in instance network info cache for port 3b01de56-e932-4de5-9e2f-ab7bc4295528. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG nova.network.neutron [req-e665110f-34eb-4404-a405-d7be8386bb87 req-a97f1f30-f18d-4078-bf06-622d662e0a16 service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Updating instance_info_cache with network_info: [{"id": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "address": "fa:16:3e:7f:a2:aa", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b01de56-e9", "ovs_interfaceid": "3b01de56-e932-4de5-9e2f-ab7bc4295528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3498e9-9800-4320-bd74-8a7f1929465d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a76a43d-57f0-4834-810f-49605c9ec1fd]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== disconnect_volume: return (321ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:10:20 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Deleting instance files /opt/stack/data/nova/instances/459ff5ca-7911-4aa8-8cfd-e85cead816a5_del
Apr 13 22:10:20 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Deletion of /opt/stack/data/nova/instances/459ff5ca-7911-4aa8-8cfd-e85cead816a5_del complete
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e665110f-34eb-4404-a405-d7be8386bb87 req-a97f1f30-f18d-4078-bf06-622d662e0a16 service nova] Releasing lock "refresh_cache-459ff5ca-7911-4aa8-8cfd-e85cead816a5" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:10:20 user nova-compute[71325]: INFO nova.compute.manager [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 13 22:10:20 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:10:20 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:10:21 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:10:21 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Took 0.49 seconds to deallocate network for instance.
Apr 13 22:10:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-bab61b61-fe45-406d-92a1-8f45fb8b7733 req-29d8b8fc-3003-48bd-ace8-0912b3b3d33a service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Received event network-vif-plugged-3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:10:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bab61b61-fe45-406d-92a1-8f45fb8b7733 req-29d8b8fc-3003-48bd-ace8-0912b3b3d33a service nova] Acquiring lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:10:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bab61b61-fe45-406d-92a1-8f45fb8b7733 req-29d8b8fc-3003-48bd-ace8-0912b3b3d33a service nova] Lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:10:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-bab61b61-fe45-406d-92a1-8f45fb8b7733 req-29d8b8fc-3003-48bd-ace8-0912b3b3d33a service nova] Lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:10:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-bab61b61-fe45-406d-92a1-8f45fb8b7733 req-29d8b8fc-3003-48bd-ace8-0912b3b3d33a service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] No waiting events found dispatching network-vif-plugged-3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:10:22 user nova-compute[71325]: WARNING nova.compute.manager [req-bab61b61-fe45-406d-92a1-8f45fb8b7733 req-29d8b8fc-3003-48bd-ace8-0912b3b3d33a service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Received unexpected event network-vif-plugged-3b01de56-e932-4de5-9e2f-ab7bc4295528 for instance with vm_state active and task_state deleting.
Apr 13 22:10:22 user nova-compute[71325]: DEBUG nova.compute.manager [req-bab61b61-fe45-406d-92a1-8f45fb8b7733 req-29d8b8fc-3003-48bd-ace8-0912b3b3d33a service nova] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Received event network-vif-deleted-3b01de56-e932-4de5-9e2f-ab7bc4295528 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:10:22 user nova-compute[71325]: INFO nova.compute.manager [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Took 1.02 seconds to detach 1 volumes for instance.
Apr 13 22:10:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:10:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:10:22 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:10:22 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:10:22 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:10:22 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:10:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:10:22 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Deleted allocations for instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5
Apr 13 22:10:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:10:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:10:22 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:10:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "459ff5ca-7911-4aa8-8cfd-e85cead816a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.175s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:10:23 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updating instance_info_cache with network_info: [{"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:10:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-03027926-4eef-4af8-afca-b70f625de6ab" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:10:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:10:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:10:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:10:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:25 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:10:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:10:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:10:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:10:25 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:10:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:10:25 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:10:25 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:10:25 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:10:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:10:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:10:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:10:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:10:26 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:10:26 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:10:26 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:10:26 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:10:26 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8359MB free_disk=26.158058166503906GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:10:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:10:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:10:27 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ada4ed22-c00b-47cd-885b-58d7eceff652 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:10:27 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 7741644e-2273-4d75-9b4d-8bf386400b07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:10:27 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 03027926-4eef-4af8-afca-b70f625de6ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:10:27 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 9b94df42-303b-484a-a778-4089323072ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:10:27 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:10:27 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:10:27 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:10:27 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:10:27 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:10:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:10:30 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:10:30 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:10:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:31 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:10:31 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:10:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:32 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:10:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "9b94df42-303b-484a-a778-4089323072ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:10:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "9b94df42-303b-484a-a778-4089323072ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:10:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "9b94df42-303b-484a-a778-4089323072ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:10:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "9b94df42-303b-484a-a778-4089323072ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:10:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "9b94df42-303b-484a-a778-4089323072ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:10:32 user nova-compute[71325]: INFO nova.compute.manager [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Terminating instance
Apr 13 22:10:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:10:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG nova.compute.manager [req-0488b424-fe68-449a-854a-864e97833021 req-35637d13-294e-457e-acef-57398ba1cb29 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] Received event network-vif-unplugged-6e8199a3-60b0-4e19-9106-76cc2118a167 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0488b424-fe68-449a-854a-864e97833021 req-35637d13-294e-457e-acef-57398ba1cb29 service nova] Acquiring lock "9b94df42-303b-484a-a778-4089323072ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0488b424-fe68-449a-854a-864e97833021 req-35637d13-294e-457e-acef-57398ba1cb29 service nova] Lock "9b94df42-303b-484a-a778-4089323072ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-0488b424-fe68-449a-854a-864e97833021 req-35637d13-294e-457e-acef-57398ba1cb29 service nova] Lock "9b94df42-303b-484a-a778-4089323072ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG nova.compute.manager [req-0488b424-fe68-449a-854a-864e97833021 req-35637d13-294e-457e-acef-57398ba1cb29 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] No waiting events found dispatching network-vif-unplugged-6e8199a3-60b0-4e19-9106-76cc2118a167 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG nova.compute.manager [req-0488b424-fe68-449a-854a-864e97833021 req-35637d13-294e-457e-acef-57398ba1cb29 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] Received event network-vif-unplugged-6e8199a3-60b0-4e19-9106-76cc2118a167 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:33 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 9b94df42-303b-484a-a778-4089323072ec] Instance destroyed successfully.
Apr 13 22:10:33 user nova-compute[71325]: DEBUG nova.objects.instance [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lazy-loading 'resources' on Instance uuid 9b94df42-303b-484a-a778-4089323072ec {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1227800336',display_name='tempest-VolumesActionsTest-instance-1227800336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1227800336',id=44,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:08:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c52a86a481f425abf1cb1d75417421e',ramdisk_id='',reservation_id='r-85mlbqv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-635015448',owner_user_name='tempest-VolumesActionsTest-635015448-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:08:43Z,user_data=None,user_id='64bf9d3c42c14ec3b22302b6fe5d52d2',uuid=9b94df42-303b-484a-a778-4089323072ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e8199a3-60b0-4e19-9106-76cc2118a167", "address": "fa:16:3e:22:e7:df", "network": {"id": "08fd4473-8ec0-42e1-81f9-f4799635112b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1156989076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7c52a86a481f425abf1cb1d75417421e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8199a3-60", "ovs_interfaceid": "6e8199a3-60b0-4e19-9106-76cc2118a167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Converting VIF {"id": "6e8199a3-60b0-4e19-9106-76cc2118a167", "address": "fa:16:3e:22:e7:df", "network": {"id": "08fd4473-8ec0-42e1-81f9-f4799635112b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1156989076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7c52a86a481f425abf1cb1d75417421e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8199a3-60", "ovs_interfaceid": "6e8199a3-60b0-4e19-9106-76cc2118a167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e7:df,bridge_name='br-int',has_traffic_filtering=True,id=6e8199a3-60b0-4e19-9106-76cc2118a167,network=Network(08fd4473-8ec0-42e1-81f9-f4799635112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e8199a3-60') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG os_vif [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e7:df,bridge_name='br-int',has_traffic_filtering=True,id=6e8199a3-60b0-4e19-9106-76cc2118a167,network=Network(08fd4473-8ec0-42e1-81f9-f4799635112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e8199a3-60') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e8199a3-60, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:10:33 user nova-compute[71325]: INFO os_vif [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e7:df,bridge_name='br-int',has_traffic_filtering=True,id=6e8199a3-60b0-4e19-9106-76cc2118a167,network=Network(08fd4473-8ec0-42e1-81f9-f4799635112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e8199a3-60')
Apr 13 22:10:33 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Deleting instance files /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec_del
Apr 13 22:10:33 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Deletion of /opt/stack/data/nova/instances/9b94df42-303b-484a-a778-4089323072ec_del complete
Apr 13 22:10:33 user nova-compute[71325]: INFO nova.compute.manager [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Took 0.78 seconds to destroy the instance on the hypervisor.
Apr 13 22:10:33 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 9b94df42-303b-484a-a778-4089323072ec] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 9b94df42-303b-484a-a778-4089323072ec] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:10:33 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 9b94df42-303b-484a-a778-4089323072ec] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:10:33 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 9b94df42-303b-484a-a778-4089323072ec] Took 0.50 seconds to deallocate network for instance.
Apr 13 22:10:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:10:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:10:34 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:10:34 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:10:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:10:34 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Deleted allocations for instance 9b94df42-303b-484a-a778-4089323072ec
Apr 13 22:10:34 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "9b94df42-303b-484a-a778-4089323072ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.673s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:10:35 user nova-compute[71325]: DEBUG nova.compute.manager [req-c5e564c7-c362-4093-a4f5-b93b60683141 req-f97cc063-4586-4db1-89fb-97c3e98cd011 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] Received event network-vif-plugged-6e8199a3-60b0-4e19-9106-76cc2118a167 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:10:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c5e564c7-c362-4093-a4f5-b93b60683141 req-f97cc063-4586-4db1-89fb-97c3e98cd011 service nova] Acquiring lock "9b94df42-303b-484a-a778-4089323072ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:10:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c5e564c7-c362-4093-a4f5-b93b60683141 req-f97cc063-4586-4db1-89fb-97c3e98cd011 service nova] Lock "9b94df42-303b-484a-a778-4089323072ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:10:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-c5e564c7-c362-4093-a4f5-b93b60683141 req-f97cc063-4586-4db1-89fb-97c3e98cd011 service nova] Lock "9b94df42-303b-484a-a778-4089323072ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:10:35 user nova-compute[71325]: DEBUG nova.compute.manager [req-c5e564c7-c362-4093-a4f5-b93b60683141 req-f97cc063-4586-4db1-89fb-97c3e98cd011 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] No waiting events found dispatching network-vif-plugged-6e8199a3-60b0-4e19-9106-76cc2118a167 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:10:35 user nova-compute[71325]: WARNING nova.compute.manager [req-c5e564c7-c362-4093-a4f5-b93b60683141 req-f97cc063-4586-4db1-89fb-97c3e98cd011 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] Received unexpected event network-vif-plugged-6e8199a3-60b0-4e19-9106-76cc2118a167 for instance with vm_state deleted and task_state None.
Apr 13 22:10:35 user nova-compute[71325]: DEBUG nova.compute.manager [req-c5e564c7-c362-4093-a4f5-b93b60683141 req-f97cc063-4586-4db1-89fb-97c3e98cd011 service nova] [instance: 9b94df42-303b-484a-a778-4089323072ec] Received event network-vif-deleted-6e8199a3-60b0-4e19-9106-76cc2118a167 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:10:35 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423820.4498734, 459ff5ca-7911-4aa8-8cfd-e85cead816a5 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:10:35 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] VM Stopped (Lifecycle Event)
Apr 13 22:10:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-7ddb8652-28bd-4d76-9af0-b84ba4135bf6 None None] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:10:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:10:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:10:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:10:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:10:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:10:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:48 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423833.3556511, 9b94df42-303b-484a-a778-4089323072ec => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:10:48 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 9b94df42-303b-484a-a778-4089323072ec] VM Stopped (Lifecycle Event)
Apr 13 22:10:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-60651078-3c10-4c4a-b9c4-d3f060cfc21c None None] [instance: 9b94df42-303b-484a-a778-4089323072ec] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:10:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:10:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:10:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:10:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:10:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:10:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:10:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:10:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:10:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:10:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:10:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "7741644e-2273-4d75-9b4d-8bf386400b07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:11:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "7741644e-2273-4d75-9b4d-8bf386400b07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:11:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:11:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:11:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:11:15 user nova-compute[71325]: INFO nova.compute.manager [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Terminating instance
Apr 13 22:11:15 user nova-compute[71325]: DEBUG nova.compute.manager [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:11:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-745f48a4-8d38-433a-987e-53c9c2cfd9b3 req-af4e03d3-4098-40e7-93ef-10213d44e8aa service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Received event network-changed-7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:11:15 user nova-compute[71325]: DEBUG nova.compute.manager [req-745f48a4-8d38-433a-987e-53c9c2cfd9b3 req-af4e03d3-4098-40e7-93ef-10213d44e8aa service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Refreshing instance network info cache due to event network-changed-7cc730c3-a97b-4fd0-8e8e-25e07a307843. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:11:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-745f48a4-8d38-433a-987e-53c9c2cfd9b3 req-af4e03d3-4098-40e7-93ef-10213d44e8aa service nova] Acquiring lock "refresh_cache-7741644e-2273-4d75-9b4d-8bf386400b07" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:11:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-745f48a4-8d38-433a-987e-53c9c2cfd9b3 req-af4e03d3-4098-40e7-93ef-10213d44e8aa service nova] Acquired lock "refresh_cache-7741644e-2273-4d75-9b4d-8bf386400b07" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:11:15 user nova-compute[71325]: DEBUG nova.network.neutron [req-745f48a4-8d38-433a-987e-53c9c2cfd9b3 req-af4e03d3-4098-40e7-93ef-10213d44e8aa service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Refreshing network info cache for port 7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:11:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG nova.compute.manager [req-2bb68f68-cbaa-4464-99f8-adafb8870b0a req-a161e313-e763-43d1-ba24-21be263de21b service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Received event network-vif-unplugged-7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2bb68f68-cbaa-4464-99f8-adafb8870b0a req-a161e313-e763-43d1-ba24-21be263de21b service nova] Acquiring lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2bb68f68-cbaa-4464-99f8-adafb8870b0a req-a161e313-e763-43d1-ba24-21be263de21b service nova] Lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-2bb68f68-cbaa-4464-99f8-adafb8870b0a req-a161e313-e763-43d1-ba24-21be263de21b service nova] Lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG nova.compute.manager [req-2bb68f68-cbaa-4464-99f8-adafb8870b0a req-a161e313-e763-43d1-ba24-21be263de21b service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] No waiting events found dispatching network-vif-unplugged-7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG nova.compute.manager [req-2bb68f68-cbaa-4464-99f8-adafb8870b0a req-a161e313-e763-43d1-ba24-21be263de21b service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Received event network-vif-unplugged-7cc730c3-a97b-4fd0-8e8e-25e07a307843 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:11:16 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Instance destroyed successfully.
Apr 13 22:11:16 user nova-compute[71325]: DEBUG nova.objects.instance [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lazy-loading 'resources' on Instance uuid 7741644e-2273-4d75-9b4d-8bf386400b07 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2080693904',display_name='tempest-TestVolumeBootPattern-server-2080693904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2080693904',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORfhunB7LA94/Vo0IeX5uHg0BK3ZrJIdCSr/QNts93zg201FlS6UuD5bquQQY3opSX8Ui/7/1jLECj4NoRXCObFsyJekLp1y4HjowC79e9IEN0rtSp6qQ2huNvtbuOLUg==',key_name='tempest-TestVolumeBootPattern-949568181',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:06:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad824150d99044c6ab1c7829cbe01de5',ramdisk_id='',reservation_id='r-h7d44vdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1335483698',owner_user_name='tempest-TestVolumeBootPattern-1335483698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:06:40Z,user_data=None,user_id='50a8a5f433c94e0c9ba4d6ecea37d756',uuid=7741644e-2273-4d75-9b4d-8bf386400b07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "address": "fa:16:3e:89:c8:6b", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc730c3-a9", "ovs_interfaceid": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converting VIF {"id": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "address": "fa:16:3e:89:c8:6b", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc730c3-a9", "ovs_interfaceid": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:c8:6b,bridge_name='br-int',has_traffic_filtering=True,id=7cc730c3-a97b-4fd0-8e8e-25e07a307843,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc730c3-a9') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_vif [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:c8:6b,bridge_name='br-int',has_traffic_filtering=True,id=7cc730c3-a97b-4fd0-8e8e-25e07a307843,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc730c3-a9') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cc730c3-a9, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:11:16 user nova-compute[71325]: INFO os_vif [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:c8:6b,bridge_name='br-int',has_traffic_filtering=True,id=7cc730c3-a97b-4fd0-8e8e-25e07a307843,network=Network(d6054eb9-3a31-4839-954a-018b5b09e633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc730c3-a9')
Apr 13 22:11:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHjyYtwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:11:16 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "03027926-4eef-4af8-afca-b70f625de6ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "03027926-4eef-4af8-afca-b70f625de6ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "03027926-4eef-4af8-afca-b70f625de6ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:11:16 user nova-compute[71325]: INFO nova.compute.manager [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Terminating instance
Apr 13 22:11:16 user nova-compute[71325]: DEBUG nova.network.neutron [req-745f48a4-8d38-433a-987e-53c9c2cfd9b3 req-af4e03d3-4098-40e7-93ef-10213d44e8aa service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Updated VIF entry in instance network info cache for port 7cc730c3-a97b-4fd0-8e8e-25e07a307843. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG nova.network.neutron [req-745f48a4-8d38-433a-987e-53c9c2cfd9b3 req-af4e03d3-4098-40e7-93ef-10213d44e8aa service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Updating instance_info_cache with network_info: [{"id": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "address": "fa:16:3e:89:c8:6b", "network": {"id": "d6054eb9-3a31-4839-954a-018b5b09e633", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1411983194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad824150d99044c6ab1c7829cbe01de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc730c3-a9", "ovs_interfaceid": "7cc730c3-a97b-4fd0-8e8e-25e07a307843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d113697c-a0e7-472c-8f5b-3a324c034e08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:11:16 user nova-compute[71325]: No targets found.
Apr 13 22:11:16 user nova-compute[71325]: iSNS:
Apr 13 22:11:16 user nova-compute[71325]: No targets found.
Apr 13 22:11:16 user nova-compute[71325]: STATIC:
Apr 13 22:11:16 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f
Apr 13 22:11:16 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:11:16 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:11:16 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772
Apr 13 22:11:16 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:11:16 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:11:16 user nova-compute[71325]: FIRMWARE:
Apr 13 22:11:16 user nova-compute[71325]: No targets found.
Apr 13 22:11:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:11:16 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:11:16 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-745f48a4-8d38-433a-987e-53c9c2cfd9b3 req-af4e03d3-4098-40e7-93ef-10213d44e8aa service nova] Releasing lock "refresh_cache-7741644e-2273-4d75-9b4d-8bf386400b07" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f860ea3f-9dc8-489a-92a8-274c2701fbe8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e20276-4c2b-428f-827b-4a0702577835]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:11:16 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:11:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f (non-flash)
Apr 13 22:11:16 user nova-compute[71325]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:11:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c4697a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a44385-3ae9-48af-b2c6-191dc7e91735]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77a0cca-475b-4d5c-bc1c-e27a60ae630f]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fbab75-3670-4db1-917c-16b9ef3a6528]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdde804-3b05-4a5f-bc60-ae27b1be6bad]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc7f537fc-140d8e1cbc427487', '/dev/disk/by-id/scsi-23134306438653163', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c7f537fc') {{(pid=82476) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c4d737-7d16-416b-a120-21d27972683f]: (4, None) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a164fbdd-9125-46c7-8933-2081ab9eb3ec]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f491db-8abd-4bcb-8a01-abfdb07e8456]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260]
Apr 13 22:11:16 user nova-compute[71325]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f, portal: 172.16.0.220,3260] successful.
Apr 13 22:11:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa56af9-4ad3-47b4-8234-7ad286b5647f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[480ad4e7-17d2-4b2a-99bd-4ad611aca07a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] <== disconnect_volume: return (341ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:11:16 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Deleting instance files /opt/stack/data/nova/instances/7741644e-2273-4d75-9b4d-8bf386400b07_del
Apr 13 22:11:16 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Deletion of /opt/stack/data/nova/instances/7741644e-2273-4d75-9b4d-8bf386400b07_del complete
Apr 13 22:11:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:16 user nova-compute[71325]: INFO nova.compute.manager [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 13 22:11:16 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:11:16 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:11:17 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Instance destroyed successfully.
Apr 13 22:11:17 user nova-compute[71325]: DEBUG nova.objects.instance [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'resources' on Instance uuid 03027926-4eef-4af8-afca-b70f625de6ab {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1601106766',display_name='tempest-ServerActionsTestJSON-server-1601106766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1601106766',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:06:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-r3zpb3tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=03027926-4eef-4af8-afca-b70f625de6ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "address": "fa:16:3e:23:ce:28", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc519a061-16", "ovs_interfaceid": "c519a061-16fb-426a-ba45-ff2fa6d655cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:ce:28,bridge_name='br-int',has_traffic_filtering=True,id=c519a061-16fb-426a-ba45-ff2fa6d655cd,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc519a061-16') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_vif [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:ce:28,bridge_name='br-int',has_traffic_filtering=True,id=c519a061-16fb-426a-ba45-ff2fa6d655cd,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc519a061-16') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc519a061-16, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:11:17 user nova-compute[71325]: INFO os_vif [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:ce:28,bridge_name='br-int',has_traffic_filtering=True,id=c519a061-16fb-426a-ba45-ff2fa6d655cd,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc519a061-16')
Apr 13 22:11:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JiZrxcnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:11:17 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccb7e0e-1112-47a3-b6df-13dd9c39fe97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:11:17 user nova-compute[71325]: No targets found.
Apr 13 22:11:17 user nova-compute[71325]: iSNS:
Apr 13 22:11:17 user nova-compute[71325]: No targets found.
Apr 13 22:11:17 user nova-compute[71325]: STATIC:
Apr 13 22:11:17 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772
Apr 13 22:11:17 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:11:17 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:11:17 user nova-compute[71325]: FIRMWARE:
Apr 13 22:11:17 user nova-compute[71325]: No targets found.
Apr 13 22:11:17 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:11:17 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:11:17 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8444cec0-5eb9-4d3f-8cb8-07351397afa7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[26acf500-1d97-4484-b9d3-a1af6a7c822a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:11:17 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 (non-flash)
Apr 13 22:11:17 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5a41e0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772'): ({'sdc'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Removing single pathed devices sdc {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[83223daf-a9f5-4a15-b4b1-14e8fb51d193]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6a8b2a-0365-4c9b-a518-608c116db88d]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flushing IO for device /dev/sdc {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:17 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Took 0.52 seconds to deallocate network for instance.
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b1caf4-200a-4226-98cf-a2ec2420fa94]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.297s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf6f2cc-591a-4aa0-83c1-cf6960f6a190]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] SCSI volumes sdc have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ba319e-d324-45a9-b50b-8a774c9fee95]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[81653284-49d5-498a-aef7-0c4baf718201]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260]
Apr 13 22:11:17 user nova-compute[71325]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772, portal: 172.16.0.220,3260] successful.
Apr 13 22:11:17 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e87d6a-37e1-4284-90fb-23b6b89ad772 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a738a0-11a9-44cb-bf7a-0b7b2114f7f4]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.558s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] <== disconnect_volume: return (558ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:11:17 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Deleting instance files /opt/stack/data/nova/instances/03027926-4eef-4af8-afca-b70f625de6ab_del
Apr 13 22:11:17 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Deletion of /opt/stack/data/nova/instances/03027926-4eef-4af8-afca-b70f625de6ab_del complete
Apr 13 22:11:17 user nova-compute[71325]: INFO nova.compute.manager [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Took 1.41 seconds to destroy the instance on the hypervisor.
Apr 13 22:11:17 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:11:17 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Received event network-vif-plugged-7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Acquiring lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Lock "7741644e-2273-4d75-9b4d-8bf386400b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] No waiting events found dispatching network-vif-plugged-7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:11:18 user nova-compute[71325]: WARNING nova.compute.manager [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Received unexpected event network-vif-plugged-7cc730c3-a97b-4fd0-8e8e-25e07a307843 for instance with vm_state active and task_state deleting.
Apr 13 22:11:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received event network-vif-unplugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Acquiring lock "03027926-4eef-4af8-afca-b70f625de6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] No waiting events found dispatching network-vif-unplugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received event network-vif-unplugged-c519a061-16fb-426a-ba45-ff2fa6d655cd for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received event network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Acquiring lock "03027926-4eef-4af8-afca-b70f625de6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Lock "03027926-4eef-4af8-afca-b70f625de6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] No waiting events found dispatching network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:11:18 user nova-compute[71325]: WARNING nova.compute.manager [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received unexpected event network-vif-plugged-c519a061-16fb-426a-ba45-ff2fa6d655cd for instance with vm_state active and task_state deleting.
Apr 13 22:11:18 user nova-compute[71325]: DEBUG nova.compute.manager [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Received event network-vif-deleted-7cc730c3-a97b-4fd0-8e8e-25e07a307843 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:11:18 user nova-compute[71325]: INFO nova.compute.manager [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Took 0.84 seconds to detach 1 volumes for instance.
Apr 13 22:11:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:11:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:11:18 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Deleted allocations for instance 7741644e-2273-4d75-9b4d-8bf386400b07
Apr 13 22:11:18 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:11:18 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Took 0.67 seconds to deallocate network for instance.
Apr 13 22:11:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "7741644e-2273-4d75-9b4d-8bf386400b07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.982s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:11:19 user nova-compute[71325]: INFO nova.compute.manager [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Took 0.77 seconds to detach 1 volumes for instance.
Apr 13 22:11:19 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Deleting volume: f7e87d6a-37e1-4284-90fb-23b6b89ad772 {{(pid=71325) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 22:11:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:11:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:11:19 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:11:19 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:11:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:11:19 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Deleted allocations for instance 03027926-4eef-4af8-afca-b70f625de6ab
Apr 13 22:11:19 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:11:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "03027926-4eef-4af8-afca-b70f625de6ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.223s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:11:20 user nova-compute[71325]: DEBUG nova.compute.manager [req-d4eb2f3d-166e-4f2c-aef8-a008d427adc2 req-ed74b790-42b6-4984-b58f-cd2019789f3b service nova] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Received event network-vif-deleted-c519a061-16fb-426a-ba45-ff2fa6d655cd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:11:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:22 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:11:22 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:11:22 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:11:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:11:22 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:11:22 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:11:22 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lazy-loading 'info_cache' on Instance uuid ada4ed22-c00b-47cd-885b-58d7eceff652 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:11:23 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Updating instance_info_cache with network_info: [{"id": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "address": "fa:16:3e:98:81:ee", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832e1c7c-c4", "ovs_interfaceid": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:11:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-ada4ed22-c00b-47cd-885b-58d7eceff652" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:11:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:11:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:11:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71325) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 22:11:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:11:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:11:24 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:11:27 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:27 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:11:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:11:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:11:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:11:27 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:11:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:27 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:11:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:11:28 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:11:28 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:11:28 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8678MB free_disk=26.174152374267578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:11:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:11:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:11:28 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance ada4ed22-c00b-47cd-885b-58d7eceff652 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:11:28 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:11:28 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:11:28 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:11:28 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:11:28 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:11:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:11:28 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:11:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Cleaning up deleted instances {{(pid=71325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 22:11:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] There are 0 instances to clean {{(pid=71325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 22:11:29 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:11:30 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:11:30 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:11:31 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423876.3921764, 7741644e-2273-4d75-9b4d-8bf386400b07 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:11:31 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] VM Stopped (Lifecycle Event)
Apr 13 22:11:31 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6be3556f-bc40-40c4-a12f-4ce7eefd6bd3 None None] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:11:32 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423877.218402, 03027926-4eef-4af8-afca-b70f625de6ab => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:11:32 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] VM Stopped (Lifecycle Event)
Apr 13 22:11:32 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:11:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-f733f330-1ff5-4c8c-b26c-ab3ddcdcbe4c None None] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:11:32 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:11:32 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:11:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:11:37 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:42 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:47 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:52 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:56 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:11:57 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:11:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:02 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:04 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:12:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:04 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:12:04 user nova-compute[71325]: INFO nova.compute.claims [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Claim successful on node user
Apr 13 22:12:04 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Refreshing inventories for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 22:12:04 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Updating ProviderTree inventory for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 22:12:04 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Updating inventory in ProviderTree for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 22:12:04 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Refreshing aggregate associations for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55, aggregates: None {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Refreshing trait associations for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:12:05 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:12:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG nova.policy [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94829076c7fa4750a1612b018b83b996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6949ee0fd24ee7a17424681e101afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:12:05 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Creating image(s)
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "/opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "/opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "/opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.134s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.130s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk 1073741824" returned: 0 in 0.049s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Successfully created port: bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Cannot resize image /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:12:05 user nova-compute[71325]: DEBUG nova.objects.instance [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'migration_context' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Ensure instance console log exists: /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Successfully updated port: bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquired lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG nova.compute.manager [req-dfceaae6-a2da-4673-bd46-24e37b37d004 req-bd4c96af-8599-483f-af48-c23ed5a637a0 service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Received event network-changed-bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG nova.compute.manager [req-dfceaae6-a2da-4673-bd46-24e37b37d004 req-bd4c96af-8599-483f-af48-c23ed5a637a0 service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Refreshing instance network info cache due to event network-changed-bf150898-7f9e-48be-9135-81e2f0b82b27. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dfceaae6-a2da-4673-bd46-24e37b37d004 req-bd4c96af-8599-483f-af48-c23ed5a637a0 service nova] Acquiring lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "ada4ed22-c00b-47cd-885b-58d7eceff652" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "ada4ed22-c00b-47cd-885b-58d7eceff652" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:06 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:06 user nova-compute[71325]: INFO nova.compute.manager [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Terminating instance
Apr 13 22:12:06 user nova-compute[71325]: DEBUG nova.compute.manager [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.network.neutron [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updating instance_info_cache with network_info: [{"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Releasing lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Instance network_info: |[{"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dfceaae6-a2da-4673-bd46-24e37b37d004 req-bd4c96af-8599-483f-af48-c23ed5a637a0 service nova] Acquired lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.network.neutron [req-dfceaae6-a2da-4673-bd46-24e37b37d004 req-bd4c96af-8599-483f-af48-c23ed5a637a0 service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Refreshing network info cache for port bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Start _get_guest_xml network_info=[{"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:07 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:12:07 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:12:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1406592688',display_name='tempest-SnapshotDataIntegrityTests-server-1406592688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1406592688',id=45,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9XkDpXhLx2lD4nmCeUpGxMpC/VFcXLSvCzntgsNgb64krEwq5BWwDBJWc1x5yyVX69xPhJUs3X6CciUn9Km/V9mjQ049ygcxsePVnYfHZd+dk8rzLWXHe57ZxDlzgQ6g==',key_name='tempest-SnapshotDataIntegrityTests-309329044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6949ee0fd24ee7a17424681e101afb',ramdisk_id='',reservation_id='r-w08mljsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2836903',owner_user_name='tempest-SnapshotDataIntegrityTests-2836903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:12:05Z,user_data=None,user_id='94829076c7fa4750a1612b018b83b996',uuid=92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Converting VIF {"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:6a:04,bridge_name='br-int',has_traffic_filtering=True,id=bf150898-7f9e-48be-9135-81e2f0b82b27,network=Network(aac8aaa5-9c86-480a-99cf-6f9f3beb2264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf150898-7f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.objects.instance [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'pci_devices' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.compute.manager [req-29399d31-270b-40ac-9a10-1b8709f28954 req-05bdd983-149f-41ba-ad88-26a1822c7f56 service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Received event network-vif-unplugged-832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-29399d31-270b-40ac-9a10-1b8709f28954 req-05bdd983-149f-41ba-ad88-26a1822c7f56 service nova] Acquiring lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-29399d31-270b-40ac-9a10-1b8709f28954 req-05bdd983-149f-41ba-ad88-26a1822c7f56 service nova] Lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-29399d31-270b-40ac-9a10-1b8709f28954 req-05bdd983-149f-41ba-ad88-26a1822c7f56 service nova] Lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.compute.manager [req-29399d31-270b-40ac-9a10-1b8709f28954 req-05bdd983-149f-41ba-ad88-26a1822c7f56 service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] No waiting events found dispatching network-vif-unplugged-832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.compute.manager [req-29399d31-270b-40ac-9a10-1b8709f28954 req-05bdd983-149f-41ba-ad88-26a1822c7f56 service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Received event network-vif-unplugged-832e1c7c-c4ab-4265-8173-6aa27ed74a1e for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:12:07 user nova-compute[71325]:   <uuid>92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c</uuid>
Apr 13 22:12:07 user nova-compute[71325]:   <name>instance-0000002d</name>
Apr 13 22:12:07 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:12:07 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:12:07 user nova-compute[71325]:   <metadata>
Apr 13 22:12:07 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:12:07 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:12:07 user nova-compute[71325]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1406592688</nova:name>
Apr 13 22:12:07 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:12:07</nova:creationTime>
Apr 13 22:12:07 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:12:07 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:12:07 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:12:07 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:12:07 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:12:07 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:12:07 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:12:07 user nova-compute[71325]:       <nova:owner>
Apr 13 22:12:07 user nova-compute[71325]:         <nova:user uuid="94829076c7fa4750a1612b018b83b996">tempest-SnapshotDataIntegrityTests-2836903-project-member</nova:user>
Apr 13 22:12:07 user nova-compute[71325]:         <nova:project uuid="6d6949ee0fd24ee7a17424681e101afb">tempest-SnapshotDataIntegrityTests-2836903</nova:project>
Apr 13 22:12:07 user nova-compute[71325]:       </nova:owner>
Apr 13 22:12:07 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 22:12:07 user nova-compute[71325]:       <nova:ports>
Apr 13 22:12:07 user nova-compute[71325]:         <nova:port uuid="bf150898-7f9e-48be-9135-81e2f0b82b27">
Apr 13 22:12:07 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 22:12:07 user nova-compute[71325]:         </nova:port>
Apr 13 22:12:07 user nova-compute[71325]:       </nova:ports>
Apr 13 22:12:07 user nova-compute[71325]:     </nova:instance>
Apr 13 22:12:07 user nova-compute[71325]:   </metadata>
Apr 13 22:12:07 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:12:07 user nova-compute[71325]:     <system>
Apr 13 22:12:07 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:12:07 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:12:07 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:12:07 user nova-compute[71325]:       <entry name="serial">92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c</entry>
Apr 13 22:12:07 user nova-compute[71325]:       <entry name="uuid">92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c</entry>
Apr 13 22:12:07 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:12:07 user nova-compute[71325]:     </system>
Apr 13 22:12:07 user nova-compute[71325]:   </sysinfo>
Apr 13 22:12:07 user nova-compute[71325]:   <os>
Apr 13 22:12:07 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:12:07 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:12:07 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:12:07 user nova-compute[71325]:   </os>
Apr 13 22:12:07 user nova-compute[71325]:   <features>
Apr 13 22:12:07 user nova-compute[71325]:     <acpi/>
Apr 13 22:12:07 user nova-compute[71325]:     <apic/>
Apr 13 22:12:07 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:12:07 user nova-compute[71325]:   </features>
Apr 13 22:12:07 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:12:07 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:12:07 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:12:07 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:12:07 user nova-compute[71325]:   </clock>
Apr 13 22:12:07 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:12:07 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:12:07 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:12:07 user nova-compute[71325]:   </cpu>
Apr 13 22:12:07 user nova-compute[71325]:   <devices>
Apr 13 22:12:07 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 22:12:07 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:12:07 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk"/>
Apr 13 22:12:07 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:12:07 user nova-compute[71325]:     </disk>
Apr 13 22:12:07 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:12:07 user nova-compute[71325]:       <mac address="fa:16:3e:29:6a:04"/>
Apr 13 22:12:07 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:12:07 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:12:07 user nova-compute[71325]:       <target dev="tapbf150898-7f"/>
Apr 13 22:12:07 user nova-compute[71325]:     </interface>
Apr 13 22:12:07 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:12:07 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/console.log" append="off"/>
Apr 13 22:12:07 user nova-compute[71325]:     </serial>
Apr 13 22:12:07 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:12:07 user nova-compute[71325]:     <video>
Apr 13 22:12:07 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:12:07 user nova-compute[71325]:     </video>
Apr 13 22:12:07 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:12:07 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:12:07 user nova-compute[71325]:     </rng>
Apr 13 22:12:07 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:12:07 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:12:07 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:12:07 user nova-compute[71325]:     </memballoon>
Apr 13 22:12:07 user nova-compute[71325]:   </devices>
Apr 13 22:12:07 user nova-compute[71325]: </domain>
Apr 13 22:12:07 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:12:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1406592688',display_name='tempest-SnapshotDataIntegrityTests-server-1406592688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1406592688',id=45,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9XkDpXhLx2lD4nmCeUpGxMpC/VFcXLSvCzntgsNgb64krEwq5BWwDBJWc1x5yyVX69xPhJUs3X6CciUn9Km/V9mjQ049ygcxsePVnYfHZd+dk8rzLWXHe57ZxDlzgQ6g==',key_name='tempest-SnapshotDataIntegrityTests-309329044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6949ee0fd24ee7a17424681e101afb',ramdisk_id='',reservation_id='r-w08mljsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2836903',owner_user_name='tempest-SnapshotDataIntegrityTests-2836903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:12:05Z,user_data=None,user_id='94829076c7fa4750a1612b018b83b996',uuid=92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Converting VIF {"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:6a:04,bridge_name='br-int',has_traffic_filtering=True,id=bf150898-7f9e-48be-9135-81e2f0b82b27,network=Network(aac8aaa5-9c86-480a-99cf-6f9f3beb2264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf150898-7f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG os_vif [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:6a:04,bridge_name='br-int',has_traffic_filtering=True,id=bf150898-7f9e-48be-9135-81e2f0b82b27,network=Network(aac8aaa5-9c86-480a-99cf-6f9f3beb2264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf150898-7f') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf150898-7f, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf150898-7f, col_values=(('external_ids', {'iface-id': 'bf150898-7f9e-48be-9135-81e2f0b82b27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:6a:04', 'vm-uuid': '92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:07 user nova-compute[71325]: INFO os_vif [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:6a:04,bridge_name='br-int',has_traffic_filtering=True,id=bf150898-7f9e-48be-9135-81e2f0b82b27,network=Network(aac8aaa5-9c86-480a-99cf-6f9f3beb2264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf150898-7f')
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] No VIF found with MAC fa:16:3e:29:6a:04, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.network.neutron [req-dfceaae6-a2da-4673-bd46-24e37b37d004 req-bd4c96af-8599-483f-af48-c23ed5a637a0 service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updated VIF entry in instance network info cache for port bf150898-7f9e-48be-9135-81e2f0b82b27. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG nova.network.neutron [req-dfceaae6-a2da-4673-bd46-24e37b37d004 req-bd4c96af-8599-483f-af48-c23ed5a637a0 service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updating instance_info_cache with network_info: [{"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:12:07 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dfceaae6-a2da-4673-bd46-24e37b37d004 req-bd4c96af-8599-483f-af48-c23ed5a637a0 service nova] Releasing lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:12:08 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Instance destroyed successfully.
Apr 13 22:12:08 user nova-compute[71325]: DEBUG nova.objects.instance [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'resources' on Instance uuid ada4ed22-c00b-47cd-885b-58d7eceff652 {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-964549732',display_name='tempest-ServerActionsTestJSON-server-964549732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-964549732',id=36,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw==',key_name='tempest-keypair-1140865131',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:02:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c086cffbafb4da68f172ab27da232d3',ramdisk_id='',reservation_id='r-8vq87rjj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-236976022',owner_user_name='tempest-ServerActionsTestJSON-236976022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:02:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3db8b01a05b43f68bfd8695253514db',uuid=ada4ed22-c00b-47cd-885b-58d7eceff652,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "address": "fa:16:3e:98:81:ee", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832e1c7c-c4", "ovs_interfaceid": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converting VIF {"id": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "address": "fa:16:3e:98:81:ee", "network": {"id": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1784901700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c086cffbafb4da68f172ab27da232d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832e1c7c-c4", "ovs_interfaceid": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:81:ee,bridge_name='br-int',has_traffic_filtering=True,id=832e1c7c-c4ab-4265-8173-6aa27ed74a1e,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap832e1c7c-c4') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG os_vif [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:81:ee,bridge_name='br-int',has_traffic_filtering=True,id=832e1c7c-c4ab-4265-8173-6aa27ed74a1e,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap832e1c7c-c4') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap832e1c7c-c4, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:08 user nova-compute[71325]: INFO os_vif [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:81:ee,bridge_name='br-int',has_traffic_filtering=True,id=832e1c7c-c4ab-4265-8173-6aa27ed74a1e,network=Network(1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap832e1c7c-c4')
Apr 13 22:12:08 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Deleting instance files /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652_del
Apr 13 22:12:08 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Deletion of /opt/stack/data/nova/instances/ada4ed22-c00b-47cd-885b-58d7eceff652_del complete
Apr 13 22:12:08 user nova-compute[71325]: INFO nova.compute.manager [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 13 22:12:08 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:12:08 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Took 0.45 seconds to deallocate network for instance.
Apr 13 22:12:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG nova.compute.manager [req-18aa371c-3a1e-40a5-a41b-3e9ca92051ec req-d94737f8-9821-402a-8dc0-cdda778f4cf1 service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Received event network-vif-deleted-832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:12:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:08 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Deleted allocations for instance ada4ed22-c00b-47cd-885b-58d7eceff652
Apr 13 22:12:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "ada4ed22-c00b-47cd-885b-58d7eceff652" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.961s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:09 user nova-compute[71325]: DEBUG nova.compute.manager [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Received event network-vif-plugged-832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:12:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] Acquiring lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] Lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] Lock "ada4ed22-c00b-47cd-885b-58d7eceff652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:09 user nova-compute[71325]: DEBUG nova.compute.manager [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] No waiting events found dispatching network-vif-plugged-832e1c7c-c4ab-4265-8173-6aa27ed74a1e {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:12:09 user nova-compute[71325]: WARNING nova.compute.manager [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Received unexpected event network-vif-plugged-832e1c7c-c4ab-4265-8173-6aa27ed74a1e for instance with vm_state deleted and task_state None.
Apr 13 22:12:09 user nova-compute[71325]: DEBUG nova.compute.manager [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Received event network-vif-plugged-bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:12:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:09 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:09 user nova-compute[71325]: DEBUG nova.compute.manager [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] No waiting events found dispatching network-vif-plugged-bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:12:09 user nova-compute[71325]: WARNING nova.compute.manager [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Received unexpected event network-vif-plugged-bf150898-7f9e-48be-9135-81e2f0b82b27 for instance with vm_state building and task_state spawning.
Apr 13 22:12:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423931.1334033, 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:12:11 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] VM Resumed (Lifecycle Event)
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:12:11 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Instance spawned successfully.
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:12:11 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681423931.134477, 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:12:11 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] VM Started (Lifecycle Event)
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:12:11 user nova-compute[71325]: INFO nova.compute.manager [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Took 5.87 seconds to spawn the instance on the hypervisor.
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.compute.manager [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:12:11 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:12:11 user nova-compute[71325]: INFO nova.compute.manager [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Took 6.58 seconds to build instance.
Apr 13 22:12:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.676s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.compute.manager [req-f9ac2b82-aeda-4b52-b157-e08d367981c7 req-ad243067-a607-4e07-8e07-ccbf0e8078a0 service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Received event network-vif-plugged-bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f9ac2b82-aeda-4b52-b157-e08d367981c7 req-ad243067-a607-4e07-8e07-ccbf0e8078a0 service nova] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f9ac2b82-aeda-4b52-b157-e08d367981c7 req-ad243067-a607-4e07-8e07-ccbf0e8078a0 service nova] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-f9ac2b82-aeda-4b52-b157-e08d367981c7 req-ad243067-a607-4e07-8e07-ccbf0e8078a0 service nova] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:11 user nova-compute[71325]: DEBUG nova.compute.manager [req-f9ac2b82-aeda-4b52-b157-e08d367981c7 req-ad243067-a607-4e07-8e07-ccbf0e8078a0 service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] No waiting events found dispatching network-vif-plugged-bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:12:11 user nova-compute[71325]: WARNING nova.compute.manager [req-f9ac2b82-aeda-4b52-b157-e08d367981c7 req-ad243067-a607-4e07-8e07-ccbf0e8078a0 service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Received unexpected event network-vif-plugged-bf150898-7f9e-48be-9135-81e2f0b82b27 for instance with vm_state active and task_state None.
Apr 13 22:12:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:17 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:12:17 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Triggering sync for uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:12:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:21 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:12:23 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681423928.0557425, ada4ed22-c00b-47cd-885b-58d7eceff652 => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:12:23 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] VM Stopped (Lifecycle Event)
Apr 13 22:12:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5a2031ec-a616-4896-99ec-a883f7348e09 None None] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:12:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:12:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:12:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:12:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:12:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:12:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:12:23 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:12:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:12:23 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:12:23 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:12:23 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lazy-loading 'info_cache' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:12:24 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updating instance_info_cache with network_info: [{"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:12:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:12:24 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:12:24 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:12:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:26 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:12:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:28 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:12:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:28 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:12:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:12:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:12:28 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:12:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:12:29 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:12:29 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:12:29 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8621MB free_disk=26.153709411621094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:12:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:12:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:12:29 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:12:29 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:12:29 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:12:29 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:12:29 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:12:29 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:12:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:12:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:32 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:12:32 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:12:32 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:12:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:34 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:12:34 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:12:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:12:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:12:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:12:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:12:38 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:12:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:12:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:12:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:12:48 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:12:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:12:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:12:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:12:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:12:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:12:58 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:02 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:03 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:08 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:13:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:13:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:13:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:13:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:18 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:13:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:13:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:13:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:13:23 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:23 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:13:24 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:13:24 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:13:24 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:13:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:13:24 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:13:24 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:13:24 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lazy-loading 'info_cache' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:13:25 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updating instance_info_cache with network_info: [{"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:13:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:13:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:13:25 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:13:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:28 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:28 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:13:28 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:13:29 user nova-compute[71325]: INFO nova.compute.claims [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Claim successful on node user
Apr 13 22:13:29 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.171s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:13:29 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:13:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:13:29 user nova-compute[71325]: DEBUG nova.policy [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cca0b25a70ee4f8e986db91bb9a54662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce27f9e91bca45b897b419eac137138c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:13:30 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Creating image(s)
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "/opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "/opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "/opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Successfully created port: 01a4590a-65f3-4dab-a361-264effceb7fd {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.419s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:13:30 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:13:30 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:13:30 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8726MB free_disk=26.142868041992188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk 1073741824" returned: 0 in 0.056s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.479s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.137s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Cannot resize image /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:13:30 user nova-compute[71325]: DEBUG nova.objects.instance [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lazy-loading 'migration_context' on Instance uuid 62dee3de-51db-45b8-aa6c-e86fe9bde3ce {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Ensure instance console log exists: /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Successfully updated port: 01a4590a-65f3-4dab-a361-264effceb7fd {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "refresh_cache-62dee3de-51db-45b8-aa6c-e86fe9bde3ce" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquired lock "refresh_cache-62dee3de-51db-45b8-aa6c-e86fe9bde3ce" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.compute.manager [req-88729b62-725d-4a8b-bc11-1104fb71ca7b req-00edbf35-7ac6-4d44-aac9-f5184eca1f35 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Received event network-changed-01a4590a-65f3-4dab-a361-264effceb7fd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.compute.manager [req-88729b62-725d-4a8b-bc11-1104fb71ca7b req-00edbf35-7ac6-4d44-aac9-f5184eca1f35 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Refreshing instance network info cache due to event network-changed-01a4590a-65f3-4dab-a361-264effceb7fd. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-88729b62-725d-4a8b-bc11-1104fb71ca7b req-00edbf35-7ac6-4d44-aac9-f5184eca1f35 service nova] Acquiring lock "refresh_cache-62dee3de-51db-45b8-aa6c-e86fe9bde3ce" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.network.neutron [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Updating instance_info_cache with network_info: [{"id": "01a4590a-65f3-4dab-a361-264effceb7fd", "address": "fa:16:3e:cb:85:dc", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a4590a-65", "ovs_interfaceid": "01a4590a-65f3-4dab-a361-264effceb7fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Releasing lock "refresh_cache-62dee3de-51db-45b8-aa6c-e86fe9bde3ce" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Instance network_info: |[{"id": "01a4590a-65f3-4dab-a361-264effceb7fd", "address": "fa:16:3e:cb:85:dc", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a4590a-65", "ovs_interfaceid": "01a4590a-65f3-4dab-a361-264effceb7fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-88729b62-725d-4a8b-bc11-1104fb71ca7b req-00edbf35-7ac6-4d44-aac9-f5184eca1f35 service nova] Acquired lock "refresh_cache-62dee3de-51db-45b8-aa6c-e86fe9bde3ce" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.network.neutron [req-88729b62-725d-4a8b-bc11-1104fb71ca7b req-00edbf35-7ac6-4d44-aac9-f5184eca1f35 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Refreshing network info cache for port 01a4590a-65f3-4dab-a361-264effceb7fd {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Start _get_guest_xml network_info=[{"id": "01a4590a-65f3-4dab-a361-264effceb7fd", "address": "fa:16:3e:cb:85:dc", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a4590a-65", "ovs_interfaceid": "01a4590a-65f3-4dab-a361-264effceb7fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:13:31 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:13:31 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1880396292',display_name='tempest-VolumesSnapshotTestJSON-instance-1880396292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1880396292',id=46,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce27f9e91bca45b897b419eac137138c',ramdisk_id='',reservation_id='r-r4grv046',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-793841889',owner_user_name='tempest-VolumesSnapshotTestJSON-793841889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:13:30Z,user_data=None,user_id='cca0b25a70ee4f8e986db91bb9a54662',uuid=62dee3de-51db-45b8-aa6c-e86fe9bde3ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01a4590a-65f3-4dab-a361-264effceb7fd", "address": "fa:16:3e:cb:85:dc", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a4590a-65", "ovs_interfaceid": "01a4590a-65f3-4dab-a361-264effceb7fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Converting VIF {"id": "01a4590a-65f3-4dab-a361-264effceb7fd", "address": "fa:16:3e:cb:85:dc", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a4590a-65", "ovs_interfaceid": "01a4590a-65f3-4dab-a361-264effceb7fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:85:dc,bridge_name='br-int',has_traffic_filtering=True,id=01a4590a-65f3-4dab-a361-264effceb7fd,network=Network(1a54a91f-df14-4f72-a7da-7925d7095861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a4590a-65') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.objects.instance [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lazy-loading 'pci_devices' on Instance uuid 62dee3de-51db-45b8-aa6c-e86fe9bde3ce {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:13:31 user nova-compute[71325]:   <uuid>62dee3de-51db-45b8-aa6c-e86fe9bde3ce</uuid>
Apr 13 22:13:31 user nova-compute[71325]:   <name>instance-0000002e</name>
Apr 13 22:13:31 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:13:31 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:13:31 user nova-compute[71325]:   <metadata>
Apr 13 22:13:31 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:13:31 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:13:31 user nova-compute[71325]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1880396292</nova:name>
Apr 13 22:13:31 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:13:31</nova:creationTime>
Apr 13 22:13:31 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:13:31 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:13:31 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:13:31 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:13:31 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:13:31 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:13:31 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:13:31 user nova-compute[71325]:       <nova:owner>
Apr 13 22:13:31 user nova-compute[71325]:         <nova:user uuid="cca0b25a70ee4f8e986db91bb9a54662">tempest-VolumesSnapshotTestJSON-793841889-project-member</nova:user>
Apr 13 22:13:31 user nova-compute[71325]:         <nova:project uuid="ce27f9e91bca45b897b419eac137138c">tempest-VolumesSnapshotTestJSON-793841889</nova:project>
Apr 13 22:13:31 user nova-compute[71325]:       </nova:owner>
Apr 13 22:13:31 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 22:13:31 user nova-compute[71325]:       <nova:ports>
Apr 13 22:13:31 user nova-compute[71325]:         <nova:port uuid="01a4590a-65f3-4dab-a361-264effceb7fd">
Apr 13 22:13:31 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 22:13:31 user nova-compute[71325]:         </nova:port>
Apr 13 22:13:31 user nova-compute[71325]:       </nova:ports>
Apr 13 22:13:31 user nova-compute[71325]:     </nova:instance>
Apr 13 22:13:31 user nova-compute[71325]:   </metadata>
Apr 13 22:13:31 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:13:31 user nova-compute[71325]:     <system>
Apr 13 22:13:31 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:13:31 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:13:31 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:13:31 user nova-compute[71325]:       <entry name="serial">62dee3de-51db-45b8-aa6c-e86fe9bde3ce</entry>
Apr 13 22:13:31 user nova-compute[71325]:       <entry name="uuid">62dee3de-51db-45b8-aa6c-e86fe9bde3ce</entry>
Apr 13 22:13:31 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:13:31 user nova-compute[71325]:     </system>
Apr 13 22:13:31 user nova-compute[71325]:   </sysinfo>
Apr 13 22:13:31 user nova-compute[71325]:   <os>
Apr 13 22:13:31 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:13:31 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:13:31 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:13:31 user nova-compute[71325]:   </os>
Apr 13 22:13:31 user nova-compute[71325]:   <features>
Apr 13 22:13:31 user nova-compute[71325]:     <acpi/>
Apr 13 22:13:31 user nova-compute[71325]:     <apic/>
Apr 13 22:13:31 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:13:31 user nova-compute[71325]:   </features>
Apr 13 22:13:31 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:13:31 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:13:31 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:13:31 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:13:31 user nova-compute[71325]:   </clock>
Apr 13 22:13:31 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:13:31 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:13:31 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:13:31 user nova-compute[71325]:   </cpu>
Apr 13 22:13:31 user nova-compute[71325]:   <devices>
Apr 13 22:13:31 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 22:13:31 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:13:31 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk"/>
Apr 13 22:13:31 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:13:31 user nova-compute[71325]:     </disk>
Apr 13 22:13:31 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:13:31 user nova-compute[71325]:       <mac address="fa:16:3e:cb:85:dc"/>
Apr 13 22:13:31 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:13:31 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:13:31 user nova-compute[71325]:       <target dev="tap01a4590a-65"/>
Apr 13 22:13:31 user nova-compute[71325]:     </interface>
Apr 13 22:13:31 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:13:31 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/console.log" append="off"/>
Apr 13 22:13:31 user nova-compute[71325]:     </serial>
Apr 13 22:13:31 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:13:31 user nova-compute[71325]:     <video>
Apr 13 22:13:31 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:13:31 user nova-compute[71325]:     </video>
Apr 13 22:13:31 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:13:31 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:13:31 user nova-compute[71325]:     </rng>
Apr 13 22:13:31 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:13:31 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:13:31 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:13:31 user nova-compute[71325]:     </memballoon>
Apr 13 22:13:31 user nova-compute[71325]:   </devices>
Apr 13 22:13:31 user nova-compute[71325]: </domain>
Apr 13 22:13:31 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1880396292',display_name='tempest-VolumesSnapshotTestJSON-instance-1880396292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1880396292',id=46,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce27f9e91bca45b897b419eac137138c',ramdisk_id='',reservation_id='r-r4grv046',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-793841889',owner_user_name='tempest-VolumesSnapshotTestJSON-793841889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:13:30Z,user_data=None,user_id='cca0b25a70ee4f8e986db91bb9a54662',uuid=62dee3de-51db-45b8-aa6c-e86fe9bde3ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01a4590a-65f3-4dab-a361-264effceb7fd", "address": "fa:16:3e:cb:85:dc", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a4590a-65", "ovs_interfaceid": "01a4590a-65f3-4dab-a361-264effceb7fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Converting VIF {"id": "01a4590a-65f3-4dab-a361-264effceb7fd", "address": "fa:16:3e:cb:85:dc", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a4590a-65", "ovs_interfaceid": "01a4590a-65f3-4dab-a361-264effceb7fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:85:dc,bridge_name='br-int',has_traffic_filtering=True,id=01a4590a-65f3-4dab-a361-264effceb7fd,network=Network(1a54a91f-df14-4f72-a7da-7925d7095861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a4590a-65') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG os_vif [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:85:dc,bridge_name='br-int',has_traffic_filtering=True,id=01a4590a-65f3-4dab-a361-264effceb7fd,network=Network(1a54a91f-df14-4f72-a7da-7925d7095861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a4590a-65') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01a4590a-65, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01a4590a-65, col_values=(('external_ids', {'iface-id': '01a4590a-65f3-4dab-a361-264effceb7fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:85:dc', 'vm-uuid': '62dee3de-51db-45b8-aa6c-e86fe9bde3ce'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:13:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:31 user nova-compute[71325]: INFO os_vif [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:85:dc,bridge_name='br-int',has_traffic_filtering=True,id=01a4590a-65f3-4dab-a361-264effceb7fd,network=Network(1a54a91f-df14-4f72-a7da-7925d7095861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a4590a-65')
Apr 13 22:13:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:13:32 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] No VIF found with MAC fa:16:3e:cb:85:dc, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:13:32 user nova-compute[71325]: DEBUG nova.network.neutron [req-88729b62-725d-4a8b-bc11-1104fb71ca7b req-00edbf35-7ac6-4d44-aac9-f5184eca1f35 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Updated VIF entry in instance network info cache for port 01a4590a-65f3-4dab-a361-264effceb7fd. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:13:32 user nova-compute[71325]: DEBUG nova.network.neutron [req-88729b62-725d-4a8b-bc11-1104fb71ca7b req-00edbf35-7ac6-4d44-aac9-f5184eca1f35 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Updating instance_info_cache with network_info: [{"id": "01a4590a-65f3-4dab-a361-264effceb7fd", "address": "fa:16:3e:cb:85:dc", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a4590a-65", "ovs_interfaceid": "01a4590a-65f3-4dab-a361-264effceb7fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:13:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-88729b62-725d-4a8b-bc11-1104fb71ca7b req-00edbf35-7ac6-4d44-aac9-f5184eca1f35 service nova] Releasing lock "refresh_cache-62dee3de-51db-45b8-aa6c-e86fe9bde3ce" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:13:33 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:13:33 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:13:33 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:13:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:33 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:33 user nova-compute[71325]: DEBUG nova.compute.manager [req-d26ae3d4-0e00-4e8a-b853-be8cbaa1b107 req-c60feb3f-8545-4a61-881b-4d4b206d2228 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Received event network-vif-plugged-01a4590a-65f3-4dab-a361-264effceb7fd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:13:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26ae3d4-0e00-4e8a-b853-be8cbaa1b107 req-c60feb3f-8545-4a61-881b-4d4b206d2228 service nova] Acquiring lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:13:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26ae3d4-0e00-4e8a-b853-be8cbaa1b107 req-c60feb3f-8545-4a61-881b-4d4b206d2228 service nova] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:13:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-d26ae3d4-0e00-4e8a-b853-be8cbaa1b107 req-c60feb3f-8545-4a61-881b-4d4b206d2228 service nova] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:13:33 user nova-compute[71325]: DEBUG nova.compute.manager [req-d26ae3d4-0e00-4e8a-b853-be8cbaa1b107 req-c60feb3f-8545-4a61-881b-4d4b206d2228 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] No waiting events found dispatching network-vif-plugged-01a4590a-65f3-4dab-a361-264effceb7fd {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:13:33 user nova-compute[71325]: WARNING nova.compute.manager [req-d26ae3d4-0e00-4e8a-b853-be8cbaa1b107 req-c60feb3f-8545-4a61-881b-4d4b206d2228 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Received unexpected event network-vif-plugged-01a4590a-65f3-4dab-a361-264effceb7fd for instance with vm_state building and task_state spawning.
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681424015.6052988, 62dee3de-51db-45b8-aa6c-e86fe9bde3ce => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:13:35 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] VM Resumed (Lifecycle Event)
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:13:35 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Instance spawned successfully.
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:13:35 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681424015.6065714, 62dee3de-51db-45b8-aa6c-e86fe9bde3ce => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:13:35 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] VM Started (Lifecycle Event)
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:13:35 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:13:35 user nova-compute[71325]: INFO nova.compute.manager [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Took 5.65 seconds to spawn the instance on the hypervisor.
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.compute.manager [req-abad51f0-d0c4-4e35-8a25-6f0eb15eec09 req-1fe896e5-cd48-440a-a76b-da7a1d96b648 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Received event network-vif-plugged-01a4590a-65f3-4dab-a361-264effceb7fd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-abad51f0-d0c4-4e35-8a25-6f0eb15eec09 req-1fe896e5-cd48-440a-a76b-da7a1d96b648 service nova] Acquiring lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-abad51f0-d0c4-4e35-8a25-6f0eb15eec09 req-1fe896e5-cd48-440a-a76b-da7a1d96b648 service nova] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-abad51f0-d0c4-4e35-8a25-6f0eb15eec09 req-1fe896e5-cd48-440a-a76b-da7a1d96b648 service nova] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:13:35 user nova-compute[71325]: DEBUG nova.compute.manager [req-abad51f0-d0c4-4e35-8a25-6f0eb15eec09 req-1fe896e5-cd48-440a-a76b-da7a1d96b648 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] No waiting events found dispatching network-vif-plugged-01a4590a-65f3-4dab-a361-264effceb7fd {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:13:35 user nova-compute[71325]: WARNING nova.compute.manager [req-abad51f0-d0c4-4e35-8a25-6f0eb15eec09 req-1fe896e5-cd48-440a-a76b-da7a1d96b648 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Received unexpected event network-vif-plugged-01a4590a-65f3-4dab-a361-264effceb7fd for instance with vm_state building and task_state spawning.
Apr 13 22:13:35 user nova-compute[71325]: INFO nova.compute.manager [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Took 6.18 seconds to build instance.
Apr 13 22:13:35 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.268s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:13:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:13:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:13:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:13:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:13:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:13:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:13:57 user nova-compute[71325]: DEBUG nova.compute.manager [req-79cf3863-d631-440b-ac07-d317e4793232 req-32b9ef99-90ec-4383-8af4-cc02853b569e service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Received event network-changed-bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:13:57 user nova-compute[71325]: DEBUG nova.compute.manager [req-79cf3863-d631-440b-ac07-d317e4793232 req-32b9ef99-90ec-4383-8af4-cc02853b569e service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Refreshing instance network info cache due to event network-changed-bf150898-7f9e-48be-9135-81e2f0b82b27. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:13:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-79cf3863-d631-440b-ac07-d317e4793232 req-32b9ef99-90ec-4383-8af4-cc02853b569e service nova] Acquiring lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:13:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-79cf3863-d631-440b-ac07-d317e4793232 req-32b9ef99-90ec-4383-8af4-cc02853b569e service nova] Acquired lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:13:57 user nova-compute[71325]: DEBUG nova.network.neutron [req-79cf3863-d631-440b-ac07-d317e4793232 req-32b9ef99-90ec-4383-8af4-cc02853b569e service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Refreshing network info cache for port bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:13:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:13:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:13:57 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'flavor' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:13:57 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:13:58 user nova-compute[71325]: INFO nova.compute.manager [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Attaching volume 1e4527be-c284-43a8-9aba-abd5cad4153b to /dev/vdb
Apr 13 22:13:58 user nova-compute[71325]: DEBUG os_brick.utils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bfdc1e-801e-426f-aca4-137318a813dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f658c7-b3be-4bca-be5f-e3df65cebd34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f953569-7a7f-46fe-b2e6-4ea136475908]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21641ad-0160-41e6-9d90-3e4ad59b02cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:13:58 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d230f8-0f78-4def-85f9-a55347bb1325]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG os_brick.utils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updating existing volume attachment record: 4807b073-4e4a-401e-aa63-07fbe878b926 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG nova.network.neutron [req-79cf3863-d631-440b-ac07-d317e4793232 req-32b9ef99-90ec-4383-8af4-cc02853b569e service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updated VIF entry in instance network info cache for port bf150898-7f9e-48be-9135-81e2f0b82b27. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG nova.network.neutron [req-79cf3863-d631-440b-ac07-d317e4793232 req-32b9ef99-90ec-4383-8af4-cc02853b569e service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updating instance_info_cache with network_info: [{"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:13:58 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-79cf3863-d631-440b-ac07-d317e4793232 req-32b9ef99-90ec-4383-8af4-cc02853b569e service nova] Releasing lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:14:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcOuUVrb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:14:02 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:14:02 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:14:02 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f73fcc-962e-446d-b1bf-03e4a427c86c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:14:02 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dd68ce-22f7-49e6-ade2-7547d655be30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b] added
Apr 13 22:14:02 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2185cc4c-c6a7-4531-9f46-ed7d7db839cb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dd9d7e-41b0-40a7-b845-41379eee841b]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XcOuUVrb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XcOuUVrb" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc204d43-d2d4-48d2-b09f-cd18b5e185ae]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XcOuUVrb'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2c1851-20a0-40a1-94a5-ee8166b25f55]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ac871e-459a-4734-a123-05e5cc10f8a2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 22:14:02 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 22:14:02 user nova-compute[71325]:  {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:14:02 user nova-compute[71325]: WARNING os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 22:14:02 user nova-compute[71325]: 
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6e96e3-ffae-4e02-9995-696fe032f7c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b, portal: 172.16.0.220,3260]
Apr 13 22:14:02 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b, portal: 172.16.0.220,3260] successful.
Apr 13 22:14:02 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[561bc816-1249-4d7f-8648-2168ef00c90a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bfd196-eb64-4547-bc59-68d797bc3b4a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b (non-flash)
Apr 13 22:14:02 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b (non-flash)
Apr 13 22:14:02 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[683d9513-4dc2-427f-9bab-c2358afbb6c5]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:14:02 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcOuUVrb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:14:03 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:14:03 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23831313433336635', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:14:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831313433336635', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:14:03 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'flavor' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:14:03 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:14:03 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:14:03 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:14:03 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:14:03 user nova-compute[71325]:   <serial>1e4527be-c284-43a8-9aba-abd5cad4153b</serial>
Apr 13 22:14:03 user nova-compute[71325]: </disk>
Apr 13 22:14:03 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:14:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:14:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:14:04 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] No VIF found with MAC fa:16:3e:29:6a:04, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:14:04 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.254s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:14:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:14:14 user nova-compute[71325]: INFO nova.compute.manager [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Detaching volume 1e4527be-c284-43a8-9aba-abd5cad4153b
Apr 13 22:14:14 user nova-compute[71325]: INFO nova.virt.block_device [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Attempting to driver detach volume 1e4527be-c284-43a8-9aba-abd5cad4153b from mountpoint /dev/vdb
Apr 13 22:14:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Attempting to detach device vdb from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:14:14 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:14:14 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:14:14 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:14:14 user nova-compute[71325]:   <serial>1e4527be-c284-43a8-9aba-abd5cad4153b</serial>
Apr 13 22:14:14 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:14:14 user nova-compute[71325]: </disk>
Apr 13 22:14:14 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:14:14 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Successfully detached device vdb from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the persistent domain config.
Apr 13 22:14:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:14:14 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:14:14 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:14:14 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:14:14 user nova-compute[71325]:   <serial>1e4527be-c284-43a8-9aba-abd5cad4153b</serial>
Apr 13 22:14:14 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:14:14 user nova-compute[71325]: </disk>
Apr 13 22:14:14 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681424054.6577432, 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:14:14 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Successfully detached device vdb from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the live domain config.
Apr 13 22:14:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcOuUVrb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:14:14 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[364216a9-caf8-4c32-b562-06307d3e077a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:14:14 user nova-compute[71325]: No targets found.
Apr 13 22:14:14 user nova-compute[71325]: iSNS:
Apr 13 22:14:14 user nova-compute[71325]: No targets found.
Apr 13 22:14:14 user nova-compute[71325]: STATIC:
Apr 13 22:14:14 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b
Apr 13 22:14:14 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:14:14 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:14:14 user nova-compute[71325]: FIRMWARE:
Apr 13 22:14:14 user nova-compute[71325]: No targets found.
Apr 13 22:14:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:14:14 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:14:14 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[739776fc-126f-49a9-9b85-0e057d44cb93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa55b58a-4e5c-476e-9d28-7ddd1dcc2246]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b (non-flash)
Apr 13 22:14:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b (non-flash)
Apr 13 22:14:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7e1dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a797b833-3974-4758-9cc6-f2a835829084]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bfd6af-4ac3-42cd-8d93-99d0e247648b]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cbd44c-119b-4b71-a8c6-be0732605f00]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[402cbf61-a6b9-4095-b346-c5b289769b25]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[354106ce-705f-48d4-89f8-eabdf7b13fb5]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b64c186-e509-4e91-99ec-0dc326a2d3e0]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b, portal: 172.16.0.220,3260]
Apr 13 22:14:14 user nova-compute[71325]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b, portal: 172.16.0.220,3260] successful.
Apr 13 22:14:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4527be-c284-43a8-9aba-abd5cad4153b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb05f83-80cc-43d8-b850-c4cc0778efcc]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] <== disconnect_volume: return (285ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:14:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:14:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:15 user nova-compute[71325]: DEBUG nova.objects.instance [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'flavor' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:14:15 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.668s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:14:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:24 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:14:25 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:14:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:14:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:14:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:14:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:14:25 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:14:25 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lazy-loading 'info_cache' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:14:26 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updating instance_info_cache with network_info: [{"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:14:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:14:26 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:14:26 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:14:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:28 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:14:29 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:14:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:14:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:14:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:14:29 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:14:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:29 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:30 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:14:30 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:14:30 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=26.122333526611328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:14:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:14:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:33 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:14:34 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:14:34 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:14:35 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:14:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:14:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:51 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:55 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:14:56 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:01 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:15:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:15:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:15:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:15:06 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG nova.objects.instance [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'flavor' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:15:08 user nova-compute[71325]: INFO nova.compute.manager [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Attaching volume aeeba610-93f9-4356-bbb3-37891432f7e6 to /dev/vdb
Apr 13 22:15:08 user nova-compute[71325]: DEBUG os_brick.utils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b388ef4-a3c0-4e9f-8378-7c1a3ebba31b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e91b1d-fb08-4054-9a18-3ac038407d3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[02146b76-6fe3-42c3-a9aa-e7fba349e46e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45a5f70-3167-46b3-a525-68897c1b388c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:15:08 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:15:08 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a2ad9a-2d87-4097-ada6-9fc9dacd95d5]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG os_brick.utils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:15:08 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updating existing volume attachment record: d3540ddb-04c2-41db-ad9f-75b9a7ec6b67 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:15:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:11 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HXrpzRxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:15:14 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:15:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:15:14 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:15:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:15:14 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bd60d0-e2cd-4427-ad9d-3b395a5dfac6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:15:14 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65b291f-7423-4ba1-90e8-ac7d3c9ca0fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6] added
Apr 13 22:15:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3502c99d-87b6-4579-8bb1-bd4448da342f]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[718cebca-f337-424d-a76a-f5df8cdfc510]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HXrpzRxa {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HXrpzRxa" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf7de33-d01e-4fb7-9acf-d88aecb09f2a]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HXrpzRxa'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fa0cb3-73c5-4b65-b9d2-4b5dd716d562]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c519fa56-4716-48a7-8220-0c009c49ae74]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 22:15:14 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 22:15:14 user nova-compute[71325]:  {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:15:14 user nova-compute[71325]: WARNING os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 22:15:14 user nova-compute[71325]: 
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[732ffe7a-0488-4b5b-b50d-57c9146f0a10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6, portal: 172.16.0.220,3260]
Apr 13 22:15:14 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6, portal: 172.16.0.220,3260] successful.
Apr 13 22:15:14 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:14 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c4527b-dc92-4d1a-9732-fe56a24e1916]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcec4b10-ea39-4a43-9115-6f8f8ed10986]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 (non-flash)
Apr 13 22:15:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 (non-flash)
Apr 13 22:15:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b3e2b1-3971-4ecd-b4c7-78a947db279d]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HXrpzRxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:15:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:15:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26131326666383962', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:15:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131326666383962', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:15:16 user nova-compute[71325]: DEBUG nova.objects.instance [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'flavor' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:15:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:15:16 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:15:16 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:15:16 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:15:16 user nova-compute[71325]:   <serial>aeeba610-93f9-4356-bbb3-37891432f7e6</serial>
Apr 13 22:15:16 user nova-compute[71325]: </disk>
Apr 13 22:15:16 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:15:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:15:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:15:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] No VIF found with MAC fa:16:3e:29:6a:04, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:15:16 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.247s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:15:16 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:15:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:15:17 user nova-compute[71325]: INFO nova.compute.manager [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Detaching volume aeeba610-93f9-4356-bbb3-37891432f7e6
Apr 13 22:15:17 user nova-compute[71325]: INFO nova.virt.block_device [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Attempting to driver detach volume aeeba610-93f9-4356-bbb3-37891432f7e6 from mountpoint /dev/vdb
Apr 13 22:15:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Attempting to detach device vdb from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:15:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:15:17 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:15:17 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:15:17 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:15:17 user nova-compute[71325]:   <serial>aeeba610-93f9-4356-bbb3-37891432f7e6</serial>
Apr 13 22:15:17 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:15:17 user nova-compute[71325]: </disk>
Apr 13 22:15:17 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:15:17 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Successfully detached device vdb from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the persistent domain config.
Apr 13 22:15:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:15:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:15:17 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:15:17 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:15:17 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:15:17 user nova-compute[71325]:   <serial>aeeba610-93f9-4356-bbb3-37891432f7e6</serial>
Apr 13 22:15:17 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:15:17 user nova-compute[71325]: </disk>
Apr 13 22:15:17 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681424118.2057157, 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:15:18 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Successfully detached device vdb from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the live domain config.
Apr 13 22:15:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HXrpzRxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:15:18 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aa321e-1b2f-4676-b705-0a9e41365f99]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:15:18 user nova-compute[71325]: No targets found.
Apr 13 22:15:18 user nova-compute[71325]: iSNS:
Apr 13 22:15:18 user nova-compute[71325]: No targets found.
Apr 13 22:15:18 user nova-compute[71325]: STATIC:
Apr 13 22:15:18 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6
Apr 13 22:15:18 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:15:18 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:15:18 user nova-compute[71325]: FIRMWARE:
Apr 13 22:15:18 user nova-compute[71325]: No targets found.
Apr 13 22:15:18 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:15:18 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:15:18 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e9f8fb-f407-45e5-bee3-4aac8ecb0407]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5f1b43-2947-442e-b55f-24cd0c37ac8b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 (non-flash)
Apr 13 22:15:18 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 (non-flash)
Apr 13 22:15:18 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7e8ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8a309d-582b-4edd-82e7-6399c6313d07]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8619fe-93f2-4875-9000-220df1656ff8]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e387b9-aa20-41cc-b4b1-da8f40a7d272]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f771c6-be4f-498b-b0b9-223f21227851]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5368ad90-6d5d-49cc-b13f-f89d54918bc6]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bf8acd-eff2-4770-8049-c3c43d372d48]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6, portal: 172.16.0.220,3260]
Apr 13 22:15:18 user nova-compute[71325]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6, portal: 172.16.0.220,3260] successful.
Apr 13 22:15:18 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeeba610-93f9-4356-bbb3-37891432f7e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02f2b30-c870-4b5b-a011-79072bae27b1]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] <== disconnect_volume: return (297ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:15:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:15:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'flavor' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:15:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.676s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:15:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:15:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:15:19 user nova-compute[71325]: DEBUG nova.objects.instance [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lazy-loading 'flavor' on Instance uuid 62dee3de-51db-45b8-aa6c-e86fe9bde3ce {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:15:19 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Ignoring supplied device name: /dev/vdb
Apr 13 22:15:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:15:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:15:19 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:15:19 user nova-compute[71325]: INFO nova.compute.manager [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Attaching volume 661382a6-4ad4-4d1a-9bde-63bd9e55d319 to /dev/vdb
Apr 13 22:15:19 user nova-compute[71325]: DEBUG os_brick.utils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:15:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff0594e-5d52-4b1b-b147-a4a2a236c4dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e505806-02ec-4cbf-8920-0e12ded47a25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4af0102-b32c-4695-b504-d08784a1d88d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dc8923-f238-4e76-8c8a-a4f5d602e713]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:15:20 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:15:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e27674-8a9c-477d-aa95-c5a6b6873073]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG os_brick.utils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Updating existing volume attachment record: 9fea1193-c322-4dbc-8441-0667a0c3bebb {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:15:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:21 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQlWSqkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:15:24 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:15:24 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:15:24 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c260de46-5ca7-4723-b528-0f614bc442d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:15:24 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[464c6534-f437-4c02-b69d-4124318e6ddc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319] added
Apr 13 22:15:24 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[120eb399-e316-422f-8500-27760bbf6632]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9651ab8-77e0-4458-a68a-0cae79523df0]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GQlWSqkH {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GQlWSqkH" returned: 0 in 0.025s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1676a1-759d-483c-8df5-4b8e6ab06f7d]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GQlWSqkH'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1926f7a7-ef38-4906-b4a6-a823ce2c8744]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6e7767-4fb2-4f40-b628-588b89e25135]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 22:15:24 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 22:15:24 user nova-compute[71325]:  {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:15:24 user nova-compute[71325]: WARNING os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 22:15:24 user nova-compute[71325]: 
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e01003-866c-4092-8acb-86c4a115924a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319, portal: 172.16.0.220,3260]
Apr 13 22:15:24 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319, portal: 172.16.0.220,3260] successful.
Apr 13 22:15:24 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcdfd92-9cf2-4233-8544-f865a1f7207d]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[399ac8b1-7b80-4954-ba04-76693c76a1c4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 (non-flash)
Apr 13 22:15:24 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 (non-flash)
Apr 13 22:15:24 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dfeb27-70e7-44b6-a51c-0a45341e51ee]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:15:24 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQlWSqkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:15:25 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:15:25 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:15:25 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:15:25 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23566366165376262', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:15:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566366165376262', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:15:25 user nova-compute[71325]: DEBUG nova.objects.instance [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lazy-loading 'flavor' on Instance uuid 62dee3de-51db-45b8-aa6c-e86fe9bde3ce {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:15:25 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:15:25 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:15:25 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:15:25 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:15:25 user nova-compute[71325]:   <serial>661382a6-4ad4-4d1a-9bde-63bd9e55d319</serial>
Apr 13 22:15:25 user nova-compute[71325]: </disk>
Apr 13 22:15:25 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:15:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-62dee3de-51db-45b8-aa6c-e86fe9bde3ce" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:15:25 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-62dee3de-51db-45b8-aa6c-e86fe9bde3ce" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:15:25 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:15:26 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:15:26 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:15:26 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] No VIF found with MAC fa:16:3e:cb:85:dc, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:15:26 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Updating instance_info_cache with network_info: [{"id": "01a4590a-65f3-4dab-a361-264effceb7fd", "address": "fa:16:3e:cb:85:dc", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a4590a-65", "ovs_interfaceid": "01a4590a-65f3-4dab-a361-264effceb7fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:15:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-62dee3de-51db-45b8-aa6c-e86fe9bde3ce" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:15:26 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:15:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.454s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:15:26 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:15:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:15:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:15:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:15:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:15:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:27 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:15:29 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:15:30 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:15:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:15:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:15:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:15:30 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:15:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:30 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:31 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:15:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:31 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:15:31 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:15:31 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8645MB free_disk=26.12097930908203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:15:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:15:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:15:31 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:15:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:15:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:15:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:15:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:15:32 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:15:32 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:15:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:15:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:15:33 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:15:33 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:15:34 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:15:35 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:15:35 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:15:35 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:15:36 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:15:41 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:15:42 user nova-compute[71325]: INFO nova.compute.manager [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Detaching volume 661382a6-4ad4-4d1a-9bde-63bd9e55d319
Apr 13 22:15:42 user nova-compute[71325]: INFO nova.virt.block_device [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Attempting to driver detach volume 661382a6-4ad4-4d1a-9bde-63bd9e55d319 from mountpoint /dev/vdb
Apr 13 22:15:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Attempting to detach device vdb from instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:15:42 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:15:42 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:15:42 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:15:42 user nova-compute[71325]:   <serial>661382a6-4ad4-4d1a-9bde-63bd9e55d319</serial>
Apr 13 22:15:42 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:15:42 user nova-compute[71325]: </disk>
Apr 13 22:15:42 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:15:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Successfully detached device vdb from instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce from the persistent domain config.
Apr 13 22:15:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:15:42 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:15:42 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:15:42 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:15:42 user nova-compute[71325]:   <serial>661382a6-4ad4-4d1a-9bde-63bd9e55d319</serial>
Apr 13 22:15:42 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:15:42 user nova-compute[71325]: </disk>
Apr 13 22:15:42 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681424142.57122, 62dee3de-51db-45b8-aa6c-e86fe9bde3ce => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:15:42 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Successfully detached device vdb from instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce from the live domain config.
Apr 13 22:15:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQlWSqkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:15:42 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49912c3-ce24-4627-948c-abb96aad53d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:15:42 user nova-compute[71325]: No targets found.
Apr 13 22:15:42 user nova-compute[71325]: iSNS:
Apr 13 22:15:42 user nova-compute[71325]: No targets found.
Apr 13 22:15:42 user nova-compute[71325]: STATIC:
Apr 13 22:15:42 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319
Apr 13 22:15:42 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:15:42 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:15:42 user nova-compute[71325]: FIRMWARE:
Apr 13 22:15:42 user nova-compute[71325]: No targets found.
Apr 13 22:15:42 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:15:42 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:15:42 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[119dc4e1-a20f-4fe4-a0ae-8a304f6422d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e34048-686a-4e51-b7f7-f7115e88366e]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 (non-flash)
Apr 13 22:15:42 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 (non-flash)
Apr 13 22:15:42 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7d51fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea0e904-7255-445e-a165-9756a5a72668]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a311b2a-adf5-4d9f-b676-53a0cb4396d4]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a54bb25-6d15-4270-b993-6147a6005e94]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f25a0f-7914-4b74-87b9-0b0c2d60d0b6]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f7e49e-23c1-4d63-8ce7-ded88d8c32d2]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c9bc51-3041-4dcd-b15d-7a5807334d93]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319, portal: 172.16.0.220,3260]
Apr 13 22:15:42 user nova-compute[71325]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319, portal: 172.16.0.220,3260] successful.
Apr 13 22:15:42 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecc5733-feb0-448d-b1e9-bce8b7f43046]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] <== disconnect_volume: return (295ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:15:42 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:15:43 user nova-compute[71325]: DEBUG nova.objects.instance [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lazy-loading 'flavor' on Instance uuid 62dee3de-51db-45b8-aa6c-e86fe9bde3ce {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:15:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.663s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:15:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.537s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:15:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:15:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:15:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:15:43 user nova-compute[71325]: INFO nova.compute.manager [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Terminating instance
Apr 13 22:15:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:15:43 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-20617dd6-320e-44f2-ab6d-10d1a50274dd req-52e09dd2-5285-4d8f-982c-0e344ccb1321 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Received event network-vif-unplugged-01a4590a-65f3-4dab-a361-264effceb7fd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:15:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-20617dd6-320e-44f2-ab6d-10d1a50274dd req-52e09dd2-5285-4d8f-982c-0e344ccb1321 service nova] Acquiring lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:15:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-20617dd6-320e-44f2-ab6d-10d1a50274dd req-52e09dd2-5285-4d8f-982c-0e344ccb1321 service nova] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:15:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-20617dd6-320e-44f2-ab6d-10d1a50274dd req-52e09dd2-5285-4d8f-982c-0e344ccb1321 service nova] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:15:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-20617dd6-320e-44f2-ab6d-10d1a50274dd req-52e09dd2-5285-4d8f-982c-0e344ccb1321 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] No waiting events found dispatching network-vif-unplugged-01a4590a-65f3-4dab-a361-264effceb7fd {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:15:43 user nova-compute[71325]: DEBUG nova.compute.manager [req-20617dd6-320e-44f2-ab6d-10d1a50274dd req-52e09dd2-5285-4d8f-982c-0e344ccb1321 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Received event network-vif-unplugged-01a4590a-65f3-4dab-a361-264effceb7fd for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:44 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Instance destroyed successfully.
Apr 13 22:15:44 user nova-compute[71325]: DEBUG nova.objects.instance [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lazy-loading 'resources' on Instance uuid 62dee3de-51db-45b8-aa6c-e86fe9bde3ce {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1880396292',display_name='tempest-VolumesSnapshotTestJSON-instance-1880396292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1880396292',id=46,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:13:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce27f9e91bca45b897b419eac137138c',ramdisk_id='',reservation_id='r-r4grv046',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-793841889',owner_user_name='tempest-VolumesSnapshotTestJSON-793841889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:13:36Z,user_data=None,user_id='cca0b25a70ee4f8e986db91bb9a54662',uuid=62dee3de-51db-45b8-aa6c-e86fe9bde3ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01a4590a-65f3-4dab-a361-264effceb7fd", "address": "fa:16:3e:cb:85:dc", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a4590a-65", "ovs_interfaceid": "01a4590a-65f3-4dab-a361-264effceb7fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Converting VIF {"id": "01a4590a-65f3-4dab-a361-264effceb7fd", "address": "fa:16:3e:cb:85:dc", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a4590a-65", "ovs_interfaceid": "01a4590a-65f3-4dab-a361-264effceb7fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:85:dc,bridge_name='br-int',has_traffic_filtering=True,id=01a4590a-65f3-4dab-a361-264effceb7fd,network=Network(1a54a91f-df14-4f72-a7da-7925d7095861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a4590a-65') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG os_vif [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:85:dc,bridge_name='br-int',has_traffic_filtering=True,id=01a4590a-65f3-4dab-a361-264effceb7fd,network=Network(1a54a91f-df14-4f72-a7da-7925d7095861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a4590a-65') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01a4590a-65, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:15:44 user nova-compute[71325]: INFO os_vif [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:85:dc,bridge_name='br-int',has_traffic_filtering=True,id=01a4590a-65f3-4dab-a361-264effceb7fd,network=Network(1a54a91f-df14-4f72-a7da-7925d7095861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a4590a-65')
Apr 13 22:15:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:661382a6-4ad4-4d1a-9bde-63bd9e55d319', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQlWSqkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:15:44 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:15:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[67284c57-0519-41a7-a29c-caf23f24bfcb]: Unexpected error while running command.
Apr 13 22:15:44 user nova-compute[71325]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 22:15:44 user nova-compute[71325]: Exit code: 21
Apr 13 22:15:44 user nova-compute[71325]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 22:15:44 user nova-compute[71325]: Stderr: '' {{(pid=82476) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 13 22:15:44 user nova-compute[71325]: Traceback (most recent call last):
Apr 13 22:15:44 user nova-compute[71325]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 13 22:15:44 user nova-compute[71325]:     ret = func(*f_args, **f_kwargs)
Apr 13 22:15:44 user nova-compute[71325]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 13 22:15:44 user nova-compute[71325]:     return func(*args, **kwargs)
Apr 13 22:15:44 user nova-compute[71325]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 13 22:15:44 user nova-compute[71325]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 13 22:15:44 user nova-compute[71325]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 13 22:15:44 user nova-compute[71325]:     return putils.execute(on_execute=on_execute,
Apr 13 22:15:44 user nova-compute[71325]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 13 22:15:44 user nova-compute[71325]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 13 22:15:44 user nova-compute[71325]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 22:15:44 user nova-compute[71325]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 22:15:44 user nova-compute[71325]: Exit code: 21
Apr 13 22:15:44 user nova-compute[71325]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 22:15:44 user nova-compute[71325]: Stderr: ''
Apr 13 22:15:44 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[67284c57-0519-41a7-a29c-caf23f24bfcb]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 22:15:44 user nova-compute[71325]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 22:15:44 user nova-compute[71325]: Exit code: 21
Apr 13 22:15:44 user nova-compute[71325]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 22:15:44 user nova-compute[71325]: Stderr: ''
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 13 22:15:44 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi 
Apr 13 22:15:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71325) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] <== disconnect_volume: return (57ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:15:44 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Deleting instance files /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce_del
Apr 13 22:15:44 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Deletion of /opt/stack/data/nova/instances/62dee3de-51db-45b8-aa6c-e86fe9bde3ce_del complete
Apr 13 22:15:44 user nova-compute[71325]: INFO nova.compute.manager [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 13 22:15:44 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:15:44 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:15:45 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:15:45 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Took 0.51 seconds to deallocate network for instance.
Apr 13 22:15:45 user nova-compute[71325]: WARNING nova.volume.cinder [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Attachment 9fea1193-c322-4dbc-8441-0667a0c3bebb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9fea1193-c322-4dbc-8441-0667a0c3bebb. (HTTP 404) (Request-ID: req-00c72743-014d-4052-b530-6c1ae374b4bd)
Apr 13 22:15:45 user nova-compute[71325]: INFO nova.compute.manager [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Took 0.02 seconds to detach 1 volumes for instance.
Apr 13 22:15:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:15:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:15:45 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:15:45 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:15:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:15:45 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Deleted allocations for instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce
Apr 13 22:15:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.792s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:15:45 user nova-compute[71325]: DEBUG nova.compute.manager [req-07de5633-3d51-4000-88d8-f1a8887f2f8e req-13fb48d4-c680-4644-a370-0a89cdbf0058 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Received event network-vif-plugged-01a4590a-65f3-4dab-a361-264effceb7fd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:15:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-07de5633-3d51-4000-88d8-f1a8887f2f8e req-13fb48d4-c680-4644-a370-0a89cdbf0058 service nova] Acquiring lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:15:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-07de5633-3d51-4000-88d8-f1a8887f2f8e req-13fb48d4-c680-4644-a370-0a89cdbf0058 service nova] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:15:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-07de5633-3d51-4000-88d8-f1a8887f2f8e req-13fb48d4-c680-4644-a370-0a89cdbf0058 service nova] Lock "62dee3de-51db-45b8-aa6c-e86fe9bde3ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:15:45 user nova-compute[71325]: DEBUG nova.compute.manager [req-07de5633-3d51-4000-88d8-f1a8887f2f8e req-13fb48d4-c680-4644-a370-0a89cdbf0058 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] No waiting events found dispatching network-vif-plugged-01a4590a-65f3-4dab-a361-264effceb7fd {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:15:45 user nova-compute[71325]: WARNING nova.compute.manager [req-07de5633-3d51-4000-88d8-f1a8887f2f8e req-13fb48d4-c680-4644-a370-0a89cdbf0058 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Received unexpected event network-vif-plugged-01a4590a-65f3-4dab-a361-264effceb7fd for instance with vm_state deleted and task_state None.
Apr 13 22:15:45 user nova-compute[71325]: DEBUG nova.compute.manager [req-07de5633-3d51-4000-88d8-f1a8887f2f8e req-13fb48d4-c680-4644-a370-0a89cdbf0058 service nova] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Received event network-vif-deleted-01a4590a-65f3-4dab-a361-264effceb7fd {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:15:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:15:59 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681424144.4401143, 62dee3de-51db-45b8-aa6c-e86fe9bde3ce => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:15:59 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] VM Stopped (Lifecycle Event)
Apr 13 22:15:59 user nova-compute[71325]: DEBUG nova.compute.manager [None req-5161b7c9-30cb-4e6d-b6a9-7d2a63f39b5e None None] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:15:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:15:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:15:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:15:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:15:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:15:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:16:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG nova.objects.instance [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'flavor' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:16:10 user nova-compute[71325]: INFO nova.compute.manager [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Attaching volume b4d0f68a-4da9-48ab-a658-605d55674101 to /dev/vdb
Apr 13 22:16:10 user nova-compute[71325]: DEBUG os_brick.utils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[175916ab-7d38-4bf4-8fb6-b60f4d7d376e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b61972-210f-438c-b917-d2f960eccc39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c53aaff-08d9-4d30-9249-fb06c926991d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c0e13-49b0-48f8-9eda-b7e1e6efe868]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:16:10 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:16:10 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6915dd-b77a-4b6d-b0dc-acc7a30f0843]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG os_brick.utils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:16:10 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updating existing volume attachment record: a083fbd8-8ea3-4b3a-9cdf-528faa5c1ad1 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:16:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjRhkmYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:16:15 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:16:15 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:16:15 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[65726b9d-192e-4a9c-a432-f611eab85d43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:16:15 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb276a53-8bbc-42ef-8c54-16073479aa0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101] added
Apr 13 22:16:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e01171b-09c7-47ad-b30b-0f200ff7e635]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f71349-7baf-4fdf-b8d4-b81fe5ab9385]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OjRhkmYs {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OjRhkmYs" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7b9092-fb88-440e-b06d-04bc90bc2b85]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OjRhkmYs'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d63adec-1fc7-491f-b28e-0f36c633bb22]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6558529-c78c-431a-8c06-d573b7d76060]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 22:16:15 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 22:16:15 user nova-compute[71325]:  {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:16:15 user nova-compute[71325]: WARNING os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 22:16:15 user nova-compute[71325]: 
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2348da-67e5-4305-beb6-174ce89c88be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101, portal: 172.16.0.220,3260]
Apr 13 22:16:15 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101, portal: 172.16.0.220,3260] successful.
Apr 13 22:16:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[33618537-f7b9-4721-87f6-cf72cc5460ea]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cfbf85-a4fa-4e34-8346-5a20048b6ac5]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 (non-flash)
Apr 13 22:16:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 (non-flash)
Apr 13 22:16:15 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[709502ac-545c-4b87-9027-794072693638]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:16:15 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjRhkmYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:16:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:16:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23137376333623663', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:16:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137376333623663', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:16:16 user nova-compute[71325]: DEBUG nova.objects.instance [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'flavor' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:16:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:16:16 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:16:16 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:16:16 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:16:16 user nova-compute[71325]:   <serial>b4d0f68a-4da9-48ab-a658-605d55674101</serial>
Apr 13 22:16:16 user nova-compute[71325]: </disk>
Apr 13 22:16:16 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:16:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:16:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:16:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] No VIF found with MAC fa:16:3e:29:6a:04, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:16:17 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.576s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:16:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:16:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:16:18 user nova-compute[71325]: INFO nova.compute.manager [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Detaching volume b4d0f68a-4da9-48ab-a658-605d55674101
Apr 13 22:16:18 user nova-compute[71325]: INFO nova.virt.block_device [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Attempting to driver detach volume b4d0f68a-4da9-48ab-a658-605d55674101 from mountpoint /dev/vdb
Apr 13 22:16:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Attempting to detach device vdb from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:16:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:16:18 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:16:18 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:16:18 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:16:18 user nova-compute[71325]:   <serial>b4d0f68a-4da9-48ab-a658-605d55674101</serial>
Apr 13 22:16:18 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:16:18 user nova-compute[71325]: </disk>
Apr 13 22:16:18 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:16:18 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Successfully detached device vdb from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the persistent domain config.
Apr 13 22:16:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:16:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:16:18 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:16:18 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:16:18 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:16:18 user nova-compute[71325]:   <serial>b4d0f68a-4da9-48ab-a658-605d55674101</serial>
Apr 13 22:16:18 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:16:18 user nova-compute[71325]: </disk>
Apr 13 22:16:18 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681424179.413258, 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:16:19 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Successfully detached device vdb from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the live domain config.
Apr 13 22:16:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjRhkmYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:16:19 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77ed742-9b82-4fbb-9dd7-1a5dc35b3d26]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:16:19 user nova-compute[71325]: No targets found.
Apr 13 22:16:19 user nova-compute[71325]: iSNS:
Apr 13 22:16:19 user nova-compute[71325]: No targets found.
Apr 13 22:16:19 user nova-compute[71325]: STATIC:
Apr 13 22:16:19 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101
Apr 13 22:16:19 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:16:19 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:16:19 user nova-compute[71325]: FIRMWARE:
Apr 13 22:16:19 user nova-compute[71325]: No targets found.
Apr 13 22:16:19 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:16:19 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:16:19 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[23660e0a-e1cc-4d4e-aa22-9525f3e760a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc2c4d3-cf81-4aa5-b13d-956bb77fde25]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 (non-flash)
Apr 13 22:16:19 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 (non-flash)
Apr 13 22:16:19 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5a41ce950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5010 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdb8882-f96f-4bb7-8d2f-80897cef7d5e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda02ef2-d0f4-43ab-b637-26bee2afda1d]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bb1b88-8f7b-4fc2-a88b-2db5966854dd]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6838a5-e39f-41b5-81ce-a358aeabae17]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[716f0bc8-1ba3-4bac-862d-3f9de72e9e42]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce4db09-49ea-4430-baf0-2372337db591]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101, portal: 172.16.0.220,3260]
Apr 13 22:16:19 user nova-compute[71325]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101, portal: 172.16.0.220,3260] successful.
Apr 13 22:16:19 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d0f68a-4da9-48ab-a658-605d55674101 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0aada4-d351-4e60-a3f4-4629044e2b0f]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] <== disconnect_volume: return (311ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:16:19 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:16:20 user nova-compute[71325]: DEBUG nova.objects.instance [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'flavor' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:16:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.688s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:16:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:22 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:16:22 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71325) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 22:16:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:26 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:16:26 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:16:26 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:16:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:16:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:16:26 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:16:26 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lazy-loading 'info_cache' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:16:27 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updating instance_info_cache with network_info: [{"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:16:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:16:27 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:16:27 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:16:28 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:16:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:16:30 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:16:31 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:16:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:16:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:16:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:16:31 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:16:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:32 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:16:32 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:16:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8712MB free_disk=26.130199432373047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:16:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:16:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:16:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:16:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:16:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:16:32 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:16:32 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:16:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:16:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:16:33 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:16:33 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Cleaning up deleted instances {{(pid=71325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 22:16:33 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] There are 0 instances to clean {{(pid=71325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 22:16:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:16:35 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:16:35 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:16:35 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:16:35 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:16:37 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:16:37 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:16:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:16:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "491ef203-bf06-4392-9270-30a02bcd6c9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:16:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:16:42 user nova-compute[71325]: DEBUG nova.compute.manager [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Starting instance... {{(pid=71325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:16:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:16:42 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:16:42 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:16:42 user nova-compute[71325]: INFO nova.compute.claims [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Claim successful on node user
Apr 13 22:16:42 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:16:42 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Start building networks asynchronously for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Allocating IP information in the background. {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG nova.network.neutron [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] allocate_for_instance() {{(pid=71325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:16:43 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:16:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Start building block device mappings for instance. {{(pid=71325) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG nova.policy [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cca0b25a70ee4f8e986db91bb9a54662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce27f9e91bca45b897b419eac137138c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71325) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG nova.compute.manager [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Start spawning the instance on the hypervisor. {{(pid=71325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Creating instance directory {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:16:43 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Creating image(s)
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "/opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "/opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "/opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.129s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.163s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk 1073741824 {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9,backing_fmt=raw /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk 1073741824" returned: 0 in 0.058s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "8e8964c84540edbbc7f027991398f2f2dc4101d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 --force-share --output=json" returned: 0 in 0.131s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk. size=1073741824 {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG nova.network.neutron [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Successfully created port: 50746410-9ced-436f-9be1-83b8b4c1d60a {{(pid=71325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG nova.virt.disk.api [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Cannot resize image /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk to a smaller size. {{(pid=71325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG nova.objects.instance [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lazy-loading 'migration_context' on Instance uuid 491ef203-bf06-4392-9270-30a02bcd6c9f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Created local disks {{(pid=71325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Ensure instance console log exists: /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/console.log {{(pid=71325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:16:43 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.network.neutron [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Successfully updated port: 50746410-9ced-436f-9be1-83b8b4c1d60a {{(pid=71325) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "refresh_cache-491ef203-bf06-4392-9270-30a02bcd6c9f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquired lock "refresh_cache-491ef203-bf06-4392-9270-30a02bcd6c9f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.network.neutron [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Building network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.network.neutron [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Instance cache missing network info. {{(pid=71325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-5a12c49f-7bb3-4333-ba36-a4213bbb155f req-22e72633-daee-495c-8112-719a9df520b1 service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Received event network-changed-50746410-9ced-436f-9be1-83b8b4c1d60a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.compute.manager [req-5a12c49f-7bb3-4333-ba36-a4213bbb155f req-22e72633-daee-495c-8112-719a9df520b1 service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Refreshing instance network info cache due to event network-changed-50746410-9ced-436f-9be1-83b8b4c1d60a. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5a12c49f-7bb3-4333-ba36-a4213bbb155f req-22e72633-daee-495c-8112-719a9df520b1 service nova] Acquiring lock "refresh_cache-491ef203-bf06-4392-9270-30a02bcd6c9f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.network.neutron [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Updating instance_info_cache with network_info: [{"id": "50746410-9ced-436f-9be1-83b8b4c1d60a", "address": "fa:16:3e:97:6f:a2", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50746410-9c", "ovs_interfaceid": "50746410-9ced-436f-9be1-83b8b4c1d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Releasing lock "refresh_cache-491ef203-bf06-4392-9270-30a02bcd6c9f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.compute.manager [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Instance network_info: |[{"id": "50746410-9ced-436f-9be1-83b8b4c1d60a", "address": "fa:16:3e:97:6f:a2", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50746410-9c", "ovs_interfaceid": "50746410-9ced-436f-9be1-83b8b4c1d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5a12c49f-7bb3-4333-ba36-a4213bbb155f req-22e72633-daee-495c-8112-719a9df520b1 service nova] Acquired lock "refresh_cache-491ef203-bf06-4392-9270-30a02bcd6c9f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.network.neutron [req-5a12c49f-7bb3-4333-ba36-a4213bbb155f req-22e72633-daee-495c-8112-719a9df520b1 service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Refreshing network info cache for port 50746410-9ced-436f-9be1-83b8b4c1d60a {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Start _get_guest_xml network_info=[{"id": "50746410-9ced-436f-9be1-83b8b4c1d60a", "address": "fa:16:3e:97:6f:a2", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50746410-9c", "ovs_interfaceid": "50746410-9ced-436f-9be1-83b8b4c1d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f414347d-1c32-419c-89fc-b23b61a6c286'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:16:44 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:16:44 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T21:42:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T21:41:23Z,direct_url=<?>,disk_format='qcow2',id=f414347d-1c32-419c-89fc-b23b61a6c286,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='1db2e02aef4246949d121a993c735999',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T21:41:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Flavor limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Image limits 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Flavor pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Image pref 0:0:0 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Got 1 possible topologies {{(pid=71325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2009437104',display_name='tempest-VolumesSnapshotTestJSON-instance-2009437104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2009437104',id=47,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce27f9e91bca45b897b419eac137138c',ramdisk_id='',reservation_id='r-pav5kt61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-793841889',owner_user_name='tempest-VolumesSnapshotTestJSON-793841889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:16:43Z,user_data=None,user_id='cca0b25a70ee4f8e986db91bb9a54662',uuid=491ef203-bf06-4392-9270-30a02bcd6c9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50746410-9ced-436f-9be1-83b8b4c1d60a", "address": "fa:16:3e:97:6f:a2", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50746410-9c", "ovs_interfaceid": "50746410-9ced-436f-9be1-83b8b4c1d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Converting VIF {"id": "50746410-9ced-436f-9be1-83b8b4c1d60a", "address": "fa:16:3e:97:6f:a2", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50746410-9c", "ovs_interfaceid": "50746410-9ced-436f-9be1-83b8b4c1d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:6f:a2,bridge_name='br-int',has_traffic_filtering=True,id=50746410-9ced-436f-9be1-83b8b4c1d60a,network=Network(1a54a91f-df14-4f72-a7da-7925d7095861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50746410-9c') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.objects.instance [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lazy-loading 'pci_devices' on Instance uuid 491ef203-bf06-4392-9270-30a02bcd6c9f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:16:44 user nova-compute[71325]:   <uuid>491ef203-bf06-4392-9270-30a02bcd6c9f</uuid>
Apr 13 22:16:44 user nova-compute[71325]:   <name>instance-0000002f</name>
Apr 13 22:16:44 user nova-compute[71325]:   <memory>131072</memory>
Apr 13 22:16:44 user nova-compute[71325]:   <vcpu>1</vcpu>
Apr 13 22:16:44 user nova-compute[71325]:   <metadata>
Apr 13 22:16:44 user nova-compute[71325]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:16:44 user nova-compute[71325]:       <nova:package version="0.0.0"/>
Apr 13 22:16:44 user nova-compute[71325]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2009437104</nova:name>
Apr 13 22:16:44 user nova-compute[71325]:       <nova:creationTime>2023-04-13 22:16:44</nova:creationTime>
Apr 13 22:16:44 user nova-compute[71325]:       <nova:flavor name="m1.nano">
Apr 13 22:16:44 user nova-compute[71325]:         <nova:memory>128</nova:memory>
Apr 13 22:16:44 user nova-compute[71325]:         <nova:disk>1</nova:disk>
Apr 13 22:16:44 user nova-compute[71325]:         <nova:swap>0</nova:swap>
Apr 13 22:16:44 user nova-compute[71325]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:16:44 user nova-compute[71325]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:16:44 user nova-compute[71325]:       </nova:flavor>
Apr 13 22:16:44 user nova-compute[71325]:       <nova:owner>
Apr 13 22:16:44 user nova-compute[71325]:         <nova:user uuid="cca0b25a70ee4f8e986db91bb9a54662">tempest-VolumesSnapshotTestJSON-793841889-project-member</nova:user>
Apr 13 22:16:44 user nova-compute[71325]:         <nova:project uuid="ce27f9e91bca45b897b419eac137138c">tempest-VolumesSnapshotTestJSON-793841889</nova:project>
Apr 13 22:16:44 user nova-compute[71325]:       </nova:owner>
Apr 13 22:16:44 user nova-compute[71325]:       <nova:root type="image" uuid="f414347d-1c32-419c-89fc-b23b61a6c286"/>
Apr 13 22:16:44 user nova-compute[71325]:       <nova:ports>
Apr 13 22:16:44 user nova-compute[71325]:         <nova:port uuid="50746410-9ced-436f-9be1-83b8b4c1d60a">
Apr 13 22:16:44 user nova-compute[71325]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 22:16:44 user nova-compute[71325]:         </nova:port>
Apr 13 22:16:44 user nova-compute[71325]:       </nova:ports>
Apr 13 22:16:44 user nova-compute[71325]:     </nova:instance>
Apr 13 22:16:44 user nova-compute[71325]:   </metadata>
Apr 13 22:16:44 user nova-compute[71325]:   <sysinfo type="smbios">
Apr 13 22:16:44 user nova-compute[71325]:     <system>
Apr 13 22:16:44 user nova-compute[71325]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:16:44 user nova-compute[71325]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:16:44 user nova-compute[71325]:       <entry name="version">0.0.0</entry>
Apr 13 22:16:44 user nova-compute[71325]:       <entry name="serial">491ef203-bf06-4392-9270-30a02bcd6c9f</entry>
Apr 13 22:16:44 user nova-compute[71325]:       <entry name="uuid">491ef203-bf06-4392-9270-30a02bcd6c9f</entry>
Apr 13 22:16:44 user nova-compute[71325]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:16:44 user nova-compute[71325]:     </system>
Apr 13 22:16:44 user nova-compute[71325]:   </sysinfo>
Apr 13 22:16:44 user nova-compute[71325]:   <os>
Apr 13 22:16:44 user nova-compute[71325]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:16:44 user nova-compute[71325]:     <boot dev="hd"/>
Apr 13 22:16:44 user nova-compute[71325]:     <smbios mode="sysinfo"/>
Apr 13 22:16:44 user nova-compute[71325]:   </os>
Apr 13 22:16:44 user nova-compute[71325]:   <features>
Apr 13 22:16:44 user nova-compute[71325]:     <acpi/>
Apr 13 22:16:44 user nova-compute[71325]:     <apic/>
Apr 13 22:16:44 user nova-compute[71325]:     <vmcoreinfo/>
Apr 13 22:16:44 user nova-compute[71325]:   </features>
Apr 13 22:16:44 user nova-compute[71325]:   <clock offset="utc">
Apr 13 22:16:44 user nova-compute[71325]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:16:44 user nova-compute[71325]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:16:44 user nova-compute[71325]:     <timer name="hpet" present="no"/>
Apr 13 22:16:44 user nova-compute[71325]:   </clock>
Apr 13 22:16:44 user nova-compute[71325]:   <cpu mode="custom" match="exact">
Apr 13 22:16:44 user nova-compute[71325]:     <model>Nehalem</model>
Apr 13 22:16:44 user nova-compute[71325]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:16:44 user nova-compute[71325]:   </cpu>
Apr 13 22:16:44 user nova-compute[71325]:   <devices>
Apr 13 22:16:44 user nova-compute[71325]:     <disk type="file" device="disk">
Apr 13 22:16:44 user nova-compute[71325]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:16:44 user nova-compute[71325]:       <source file="/opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk"/>
Apr 13 22:16:44 user nova-compute[71325]:       <target dev="vda" bus="virtio"/>
Apr 13 22:16:44 user nova-compute[71325]:     </disk>
Apr 13 22:16:44 user nova-compute[71325]:     <interface type="ethernet">
Apr 13 22:16:44 user nova-compute[71325]:       <mac address="fa:16:3e:97:6f:a2"/>
Apr 13 22:16:44 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:16:44 user nova-compute[71325]:       <mtu size="1442"/>
Apr 13 22:16:44 user nova-compute[71325]:       <target dev="tap50746410-9c"/>
Apr 13 22:16:44 user nova-compute[71325]:     </interface>
Apr 13 22:16:44 user nova-compute[71325]:     <serial type="pty">
Apr 13 22:16:44 user nova-compute[71325]:       <log file="/opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/console.log" append="off"/>
Apr 13 22:16:44 user nova-compute[71325]:     </serial>
Apr 13 22:16:44 user nova-compute[71325]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:16:44 user nova-compute[71325]:     <video>
Apr 13 22:16:44 user nova-compute[71325]:       <model type="virtio"/>
Apr 13 22:16:44 user nova-compute[71325]:     </video>
Apr 13 22:16:44 user nova-compute[71325]:     <rng model="virtio">
Apr 13 22:16:44 user nova-compute[71325]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:16:44 user nova-compute[71325]:     </rng>
Apr 13 22:16:44 user nova-compute[71325]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:16:44 user nova-compute[71325]:     <memballoon model="virtio">
Apr 13 22:16:44 user nova-compute[71325]:       <stats period="10"/>
Apr 13 22:16:44 user nova-compute[71325]:     </memballoon>
Apr 13 22:16:44 user nova-compute[71325]:   </devices>
Apr 13 22:16:44 user nova-compute[71325]: </domain>
Apr 13 22:16:44 user nova-compute[71325]:  {{(pid=71325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2009437104',display_name='tempest-VolumesSnapshotTestJSON-instance-2009437104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2009437104',id=47,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce27f9e91bca45b897b419eac137138c',ramdisk_id='',reservation_id='r-pav5kt61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-793841889',owner_user_name='tempest-VolumesSnapshotTestJSON-793841889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:16:43Z,user_data=None,user_id='cca0b25a70ee4f8e986db91bb9a54662',uuid=491ef203-bf06-4392-9270-30a02bcd6c9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50746410-9ced-436f-9be1-83b8b4c1d60a", "address": "fa:16:3e:97:6f:a2", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50746410-9c", "ovs_interfaceid": "50746410-9ced-436f-9be1-83b8b4c1d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Converting VIF {"id": "50746410-9ced-436f-9be1-83b8b4c1d60a", "address": "fa:16:3e:97:6f:a2", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50746410-9c", "ovs_interfaceid": "50746410-9ced-436f-9be1-83b8b4c1d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:6f:a2,bridge_name='br-int',has_traffic_filtering=True,id=50746410-9ced-436f-9be1-83b8b4c1d60a,network=Network(1a54a91f-df14-4f72-a7da-7925d7095861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50746410-9c') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG os_vif [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:6f:a2,bridge_name='br-int',has_traffic_filtering=True,id=50746410-9ced-436f-9be1-83b8b4c1d60a,network=Network(1a54a91f-df14-4f72-a7da-7925d7095861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50746410-9c') {{(pid=71325) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50746410-9c, may_exist=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50746410-9c, col_values=(('external_ids', {'iface-id': '50746410-9ced-436f-9be1-83b8b4c1d60a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:6f:a2', 'vm-uuid': '491ef203-bf06-4392-9270-30a02bcd6c9f'}),)) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:16:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:44 user nova-compute[71325]: INFO os_vif [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:6f:a2,bridge_name='br-int',has_traffic_filtering=True,id=50746410-9ced-436f-9be1-83b8b4c1d60a,network=Network(1a54a91f-df14-4f72-a7da-7925d7095861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50746410-9c')
Apr 13 22:16:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:16:45 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] No VIF found with MAC fa:16:3e:97:6f:a2, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:16:45 user nova-compute[71325]: DEBUG nova.network.neutron [req-5a12c49f-7bb3-4333-ba36-a4213bbb155f req-22e72633-daee-495c-8112-719a9df520b1 service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Updated VIF entry in instance network info cache for port 50746410-9ced-436f-9be1-83b8b4c1d60a. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:16:45 user nova-compute[71325]: DEBUG nova.network.neutron [req-5a12c49f-7bb3-4333-ba36-a4213bbb155f req-22e72633-daee-495c-8112-719a9df520b1 service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Updating instance_info_cache with network_info: [{"id": "50746410-9ced-436f-9be1-83b8b4c1d60a", "address": "fa:16:3e:97:6f:a2", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50746410-9c", "ovs_interfaceid": "50746410-9ced-436f-9be1-83b8b4c1d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:16:45 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-5a12c49f-7bb3-4333-ba36-a4213bbb155f req-22e72633-daee-495c-8112-719a9df520b1 service nova] Releasing lock "refresh_cache-491ef203-bf06-4392-9270-30a02bcd6c9f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:16:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:46 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-37e68cda-dc57-4d7b-805d-61a8263c2c4e req-b5a32d32-b7f0-4e8e-8a21-bb77c4b88031 service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Received event network-vif-plugged-50746410-9ced-436f-9be1-83b8b4c1d60a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:16:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-37e68cda-dc57-4d7b-805d-61a8263c2c4e req-b5a32d32-b7f0-4e8e-8a21-bb77c4b88031 service nova] Acquiring lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:16:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-37e68cda-dc57-4d7b-805d-61a8263c2c4e req-b5a32d32-b7f0-4e8e-8a21-bb77c4b88031 service nova] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:16:46 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-37e68cda-dc57-4d7b-805d-61a8263c2c4e req-b5a32d32-b7f0-4e8e-8a21-bb77c4b88031 service nova] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:16:46 user nova-compute[71325]: DEBUG nova.compute.manager [req-37e68cda-dc57-4d7b-805d-61a8263c2c4e req-b5a32d32-b7f0-4e8e-8a21-bb77c4b88031 service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] No waiting events found dispatching network-vif-plugged-50746410-9ced-436f-9be1-83b8b4c1d60a {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:16:46 user nova-compute[71325]: WARNING nova.compute.manager [req-37e68cda-dc57-4d7b-805d-61a8263c2c4e req-b5a32d32-b7f0-4e8e-8a21-bb77c4b88031 service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Received unexpected event network-vif-plugged-50746410-9ced-436f-9be1-83b8b4c1d60a for instance with vm_state building and task_state spawning.
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681424208.5203772, 491ef203-bf06-4392-9270-30a02bcd6c9f => Resumed> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:16:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] VM Resumed (Lifecycle Event)
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Instance event wait completed in 0 seconds for  {{(pid=71325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Guest created on hypervisor {{(pid=71325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:16:48 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Instance spawned successfully.
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Found default for hw_cdrom_bus of ide {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Found default for hw_disk_bus of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Found default for hw_input_bus of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Found default for hw_pointer_model of None {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Found default for hw_video_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Found default for hw_vif_model of virtio {{(pid=71325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:16:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.virt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Emitting event <LifecycleEvent: 1681424208.52505, 491ef203-bf06-4392-9270-30a02bcd6c9f => Started> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:16:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] VM Started (Lifecycle Event)
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:16:48 user nova-compute[71325]: INFO nova.compute.manager [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Took 5.44 seconds to spawn the instance on the hypervisor.
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.compute.manager [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:16:48 user nova-compute[71325]: INFO nova.compute.manager [None req-407220e4-cb14-404b-9e23-150615938b70 None None] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-453e8497-500a-4ff6-a20d-1e2bd25e77ba req-182f79ec-dc48-4ea2-860c-73d071a08cee service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Received event network-vif-plugged-50746410-9ced-436f-9be1-83b8b4c1d60a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:16:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-453e8497-500a-4ff6-a20d-1e2bd25e77ba req-182f79ec-dc48-4ea2-860c-73d071a08cee service nova] Acquiring lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:16:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-453e8497-500a-4ff6-a20d-1e2bd25e77ba req-182f79ec-dc48-4ea2-860c-73d071a08cee service nova] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:16:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-453e8497-500a-4ff6-a20d-1e2bd25e77ba req-182f79ec-dc48-4ea2-860c-73d071a08cee service nova] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:16:48 user nova-compute[71325]: DEBUG nova.compute.manager [req-453e8497-500a-4ff6-a20d-1e2bd25e77ba req-182f79ec-dc48-4ea2-860c-73d071a08cee service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] No waiting events found dispatching network-vif-plugged-50746410-9ced-436f-9be1-83b8b4c1d60a {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:16:48 user nova-compute[71325]: WARNING nova.compute.manager [req-453e8497-500a-4ff6-a20d-1e2bd25e77ba req-182f79ec-dc48-4ea2-860c-73d071a08cee service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Received unexpected event network-vif-plugged-50746410-9ced-436f-9be1-83b8b4c1d60a for instance with vm_state building and task_state spawning.
Apr 13 22:16:48 user nova-compute[71325]: INFO nova.compute.manager [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Took 6.04 seconds to build instance.
Apr 13 22:16:48 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.139s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:16:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:16:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:17:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:17:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:17:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:17:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:17:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:17:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:17:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:17:11 user nova-compute[71325]: DEBUG nova.objects.instance [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'flavor' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:17:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:17:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:17:11 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:17:11 user nova-compute[71325]: INFO nova.compute.manager [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Attaching volume b675f687-8d31-45b7-a158-c5c544f9aed0 to /dev/vdb
Apr 13 22:17:12 user nova-compute[71325]: DEBUG os_brick.utils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[719d8733-30a6-4075-bb26-eb8fd2dbfc7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f98f18-5e9a-4043-8391-1382a0b1f993]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c970332c-b049-4299-95a7-e0295f349923]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5f85c8-35e2-437e-b96c-82570f262020]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:17:12 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:17:12 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adae9ae-027a-4968-abb5-010d8ec894fe]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG os_brick.utils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:17:12 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updating existing volume attachment record: 204b7883-a945-4f6c-8d88-d5ab4542e24e {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:17:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:17:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWLYfPKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:17:16 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:17:16 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:17:16 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5f5db5-ccb3-4cf7-bd0e-fbef8b607ce6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:17:16 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[19047d1b-3f2b-47bc-afc3-4290bc5dc643]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0] added
Apr 13 22:17:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[716a6798-4e37-455c-9539-f7b58fd40f5c]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4fc105-4d7d-4fc0-987d-f316f17163eb]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lWLYfPKZ {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lWLYfPKZ" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebdfd36-1fb3-47fa-a3f3-7da218859dec]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lWLYfPKZ'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[578aa9ee-21a0-4cef-b0f0-d9da2deac519]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[97583ec3-83c2-4194-b24b-8f4e2cf971a6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 22:17:16 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 22:17:16 user nova-compute[71325]:  {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:17:16 user nova-compute[71325]: WARNING os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 22:17:16 user nova-compute[71325]: 
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[06de71f1-1501-4c85-83ec-f89b8575793e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0, portal: 172.16.0.220,3260]
Apr 13 22:17:16 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0, portal: 172.16.0.220,3260] successful.
Apr 13 22:17:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a52296-a604-4dbb-95ae-212e4d59e699]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40ae358-75a2-43e3-aa26-becd63310725]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 (non-flash)
Apr 13 22:17:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 (non-flash)
Apr 13 22:17:16 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ad6dd7-a165-4a2e-9407-62c9117c8735]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:16 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:17:17 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:17:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWLYfPKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:17:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:17:17 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26538323939393464', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:17:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538323939393464', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:17:17 user nova-compute[71325]: DEBUG nova.objects.instance [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'flavor' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:17:17 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:17:17 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:17:17 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:17:17 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:17:17 user nova-compute[71325]:   <serial>b675f687-8d31-45b7-a158-c5c544f9aed0</serial>
Apr 13 22:17:17 user nova-compute[71325]: </disk>
Apr 13 22:17:17 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:17:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:17:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:17:18 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] No VIF found with MAC fa:16:3e:29:6a:04, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:17:18 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.389s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:17:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:17:20 user nova-compute[71325]: INFO nova.compute.manager [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Detaching volume b675f687-8d31-45b7-a158-c5c544f9aed0
Apr 13 22:17:20 user nova-compute[71325]: INFO nova.virt.block_device [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Attempting to driver detach volume b675f687-8d31-45b7-a158-c5c544f9aed0 from mountpoint /dev/vdb
Apr 13 22:17:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Attempting to detach device vdb from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:17:20 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:17:20 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:17:20 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:17:20 user nova-compute[71325]:   <serial>b675f687-8d31-45b7-a158-c5c544f9aed0</serial>
Apr 13 22:17:20 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:17:20 user nova-compute[71325]: </disk>
Apr 13 22:17:20 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:17:20 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Successfully detached device vdb from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the persistent domain config.
Apr 13 22:17:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:17:20 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:17:20 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:17:20 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:17:20 user nova-compute[71325]:   <serial>b675f687-8d31-45b7-a158-c5c544f9aed0</serial>
Apr 13 22:17:20 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:17:20 user nova-compute[71325]: </disk>
Apr 13 22:17:20 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681424240.5332866, 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:17:20 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Successfully detached device vdb from instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c from the live domain config.
Apr 13 22:17:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWLYfPKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:17:20 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c628b5d7-5907-43e0-bdee-8e2b61395957]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:17:20 user nova-compute[71325]: No targets found.
Apr 13 22:17:20 user nova-compute[71325]: iSNS:
Apr 13 22:17:20 user nova-compute[71325]: No targets found.
Apr 13 22:17:20 user nova-compute[71325]: STATIC:
Apr 13 22:17:20 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0
Apr 13 22:17:20 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:17:20 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:17:20 user nova-compute[71325]: FIRMWARE:
Apr 13 22:17:20 user nova-compute[71325]: No targets found.
Apr 13 22:17:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:17:20 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:17:20 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b373ab-d22d-4a87-9faf-cd854bb2a005]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64a78e6-fa2f-40fb-9cff-0609faf8e423]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 (non-flash)
Apr 13 22:17:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 (non-flash)
Apr 13 22:17:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5d7dcfeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f0500e-f246-49c3-b4b2-67174d7a078e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b445a63-83f5-436c-b99e-70063617b2e4]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7916b7-7547-421e-a310-3e0e642c3ff6]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7262ffb5-32a5-47b0-9621-0bdad3c8f225]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13c64a2-83fa-46ad-a4f5-6f3b05133c79]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed3392c-9b20-4759-9e88-df11745ed93f]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0, portal: 172.16.0.220,3260]
Apr 13 22:17:20 user nova-compute[71325]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0, portal: 172.16.0.220,3260] successful.
Apr 13 22:17:20 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b675f687-8d31-45b7-a158-c5c544f9aed0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f759b413-c083-47cc-9422-c177657645c6]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] <== disconnect_volume: return (280ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:17:20 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:17:21 user nova-compute[71325]: DEBUG nova.objects.instance [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'flavor' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:17:21 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.742s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:17:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:17:26 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:17:28 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:17:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:17:28 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:17:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:17:28 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:17:28 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:17:28 user nova-compute[71325]: DEBUG nova.objects.instance [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lazy-loading 'info_cache' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:17:29 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updating instance_info_cache with network_info: [{"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:17:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:17:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:17:29 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:17:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:17:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:17:31 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:17:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:17:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:17:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:17:31 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:17:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:17:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:17:32 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:17:32 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:17:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8641MB free_disk=26.109447479248047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:17:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:17:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:17:33 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:17:33 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 491ef203-bf06-4392-9270-30a02bcd6c9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:17:33 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:17:33 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:17:33 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Refreshing inventories for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 22:17:33 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Updating ProviderTree inventory for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 22:17:33 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Updating inventory in ProviderTree for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 22:17:33 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Refreshing aggregate associations for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55, aggregates: None {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 22:17:33 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Refreshing trait associations for resource provider 2eb44a42-41ff-4980-ae1c-f21099638e55, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE {{(pid=71325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 22:17:33 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:17:33 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:17:33 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:17:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:17:34 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:17:34 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:17:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:17:36 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:17:36 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:17:37 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:17:38 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:17:38 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:17:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:17:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:17:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:17:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:17:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:00 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:05 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:10 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:15 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:18:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:18:26 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:26 user nova-compute[71325]: DEBUG nova.compute.manager [req-46e018a3-18bc-46e3-93a8-858ed5d0fbe3 req-fb9df6cd-4377-4b12-a2c5-4b7fd1c2fe3c service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Received event network-changed-bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:18:26 user nova-compute[71325]: DEBUG nova.compute.manager [req-46e018a3-18bc-46e3-93a8-858ed5d0fbe3 req-fb9df6cd-4377-4b12-a2c5-4b7fd1c2fe3c service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Refreshing instance network info cache due to event network-changed-bf150898-7f9e-48be-9135-81e2f0b82b27. {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:18:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-46e018a3-18bc-46e3-93a8-858ed5d0fbe3 req-fb9df6cd-4377-4b12-a2c5-4b7fd1c2fe3c service nova] Acquiring lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:18:26 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-46e018a3-18bc-46e3-93a8-858ed5d0fbe3 req-fb9df6cd-4377-4b12-a2c5-4b7fd1c2fe3c service nova] Acquired lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:18:26 user nova-compute[71325]: DEBUG nova.network.neutron [req-46e018a3-18bc-46e3-93a8-858ed5d0fbe3 req-fb9df6cd-4377-4b12-a2c5-4b7fd1c2fe3c service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Refreshing network info cache for port bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:18:27 user nova-compute[71325]: DEBUG nova.network.neutron [req-46e018a3-18bc-46e3-93a8-858ed5d0fbe3 req-fb9df6cd-4377-4b12-a2c5-4b7fd1c2fe3c service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updated VIF entry in instance network info cache for port bf150898-7f9e-48be-9135-81e2f0b82b27. {{(pid=71325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:18:27 user nova-compute[71325]: DEBUG nova.network.neutron [req-46e018a3-18bc-46e3-93a8-858ed5d0fbe3 req-fb9df6cd-4377-4b12-a2c5-4b7fd1c2fe3c service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updating instance_info_cache with network_info: [{"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:18:27 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-46e018a3-18bc-46e3-93a8-858ed5d0fbe3 req-fb9df6cd-4377-4b12-a2c5-4b7fd1c2fe3c service nova] Releasing lock "refresh_cache-92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:18:27 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:18:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:29 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:29 user nova-compute[71325]: INFO nova.compute.manager [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Terminating instance
Apr 13 22:18:29 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG nova.compute.manager [req-46f4b573-0ad1-47c4-8d75-2592ebaa99d4 req-289a7416-4253-4561-9774-79823168812e service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Received event network-vif-unplugged-bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-46f4b573-0ad1-47c4-8d75-2592ebaa99d4 req-289a7416-4253-4561-9774-79823168812e service nova] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-46f4b573-0ad1-47c4-8d75-2592ebaa99d4 req-289a7416-4253-4561-9774-79823168812e service nova] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-46f4b573-0ad1-47c4-8d75-2592ebaa99d4 req-289a7416-4253-4561-9774-79823168812e service nova] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG nova.compute.manager [req-46f4b573-0ad1-47c4-8d75-2592ebaa99d4 req-289a7416-4253-4561-9774-79823168812e service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] No waiting events found dispatching network-vif-unplugged-bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG nova.compute.manager [req-46f4b573-0ad1-47c4-8d75-2592ebaa99d4 req-289a7416-4253-4561-9774-79823168812e service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Received event network-vif-unplugged-bf150898-7f9e-48be-9135-81e2f0b82b27 for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:30 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Instance destroyed successfully.
Apr 13 22:18:30 user nova-compute[71325]: DEBUG nova.objects.instance [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'resources' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:12:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1406592688',display_name='tempest-SnapshotDataIntegrityTests-server-1406592688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1406592688',id=45,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9XkDpXhLx2lD4nmCeUpGxMpC/VFcXLSvCzntgsNgb64krEwq5BWwDBJWc1x5yyVX69xPhJUs3X6CciUn9Km/V9mjQ049ygcxsePVnYfHZd+dk8rzLWXHe57ZxDlzgQ6g==',key_name='tempest-SnapshotDataIntegrityTests-309329044',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:12:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d6949ee0fd24ee7a17424681e101afb',ramdisk_id='',reservation_id='r-w08mljsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2836903',owner_user_name='tempest-SnapshotDataIntegrityTests-2836903-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:12:11Z,user_data=None,user_id='94829076c7fa4750a1612b018b83b996',uuid=92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Converting VIF {"id": "bf150898-7f9e-48be-9135-81e2f0b82b27", "address": "fa:16:3e:29:6a:04", "network": {"id": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1090824340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6949ee0fd24ee7a17424681e101afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf150898-7f", "ovs_interfaceid": "bf150898-7f9e-48be-9135-81e2f0b82b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:6a:04,bridge_name='br-int',has_traffic_filtering=True,id=bf150898-7f9e-48be-9135-81e2f0b82b27,network=Network(aac8aaa5-9c86-480a-99cf-6f9f3beb2264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf150898-7f') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG os_vif [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:6a:04,bridge_name='br-int',has_traffic_filtering=True,id=bf150898-7f9e-48be-9135-81e2f0b82b27,network=Network(aac8aaa5-9c86-480a-99cf-6f9f3beb2264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf150898-7f') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf150898-7f, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "refresh_cache-491ef203-bf06-4392-9270-30a02bcd6c9f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquired lock "refresh_cache-491ef203-bf06-4392-9270-30a02bcd6c9f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Forcefully refreshing network info cache for instance {{(pid=71325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:18:30 user nova-compute[71325]: INFO os_vif [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:6a:04,bridge_name='br-int',has_traffic_filtering=True,id=bf150898-7f9e-48be-9135-81e2f0b82b27,network=Network(aac8aaa5-9c86-480a-99cf-6f9f3beb2264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf150898-7f')
Apr 13 22:18:30 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Deleting instance files /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c_del
Apr 13 22:18:30 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Deletion of /opt/stack/data/nova/instances/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c_del complete
Apr 13 22:18:30 user nova-compute[71325]: INFO nova.compute.manager [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 13 22:18:30 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:18:30 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:18:31 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Took 0.46 seconds to deallocate network for instance.
Apr 13 22:18:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:31 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Deleted allocations for instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c
Apr 13 22:18:31 user nova-compute[71325]: DEBUG nova.network.neutron [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Updating instance_info_cache with network_info: [{"id": "50746410-9ced-436f-9be1-83b8b4c1d60a", "address": "fa:16:3e:97:6f:a2", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50746410-9c", "ovs_interfaceid": "50746410-9ced-436f-9be1-83b8b4c1d60a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Releasing lock "refresh_cache-491ef203-bf06-4392-9270-30a02bcd6c9f" {{(pid=71325) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Updated the network info_cache for instance {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.799s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:18:31 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk --force-share --output=json {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-676a18b4-6167-44e7-ae95-8235cbf985ec req-473b8429-4419-47e3-b2a0-dc389276e8a6 service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Received event network-vif-plugged-bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-676a18b4-6167-44e7-ae95-8235cbf985ec req-473b8429-4419-47e3-b2a0-dc389276e8a6 service nova] Acquiring lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-676a18b4-6167-44e7-ae95-8235cbf985ec req-473b8429-4419-47e3-b2a0-dc389276e8a6 service nova] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-676a18b4-6167-44e7-ae95-8235cbf985ec req-473b8429-4419-47e3-b2a0-dc389276e8a6 service nova] Lock "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-676a18b4-6167-44e7-ae95-8235cbf985ec req-473b8429-4419-47e3-b2a0-dc389276e8a6 service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] No waiting events found dispatching network-vif-plugged-bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:18:32 user nova-compute[71325]: WARNING nova.compute.manager [req-676a18b4-6167-44e7-ae95-8235cbf985ec req-473b8429-4419-47e3-b2a0-dc389276e8a6 service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Received unexpected event network-vif-plugged-bf150898-7f9e-48be-9135-81e2f0b82b27 for instance with vm_state deleted and task_state None.
Apr 13 22:18:32 user nova-compute[71325]: DEBUG nova.compute.manager [req-676a18b4-6167-44e7-ae95-8235cbf985ec req-473b8429-4419-47e3-b2a0-dc389276e8a6 service nova] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Received event network-vif-deleted-bf150898-7f9e-48be-9135-81e2f0b82b27 {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:18:32 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:18:32 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:18:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8712MB free_disk=26.128135681152344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Instance 491ef203-bf06-4392-9270-30a02bcd6c9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "491ef203-bf06-4392-9270-30a02bcd6c9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG nova.objects.instance [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lazy-loading 'flavor' on Instance uuid 491ef203-bf06-4392-9270-30a02bcd6c9f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:18:33 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Ignoring supplied device name: /dev/vdb
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "491ef203-bf06-4392-9270-30a02bcd6c9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:33 user nova-compute[71325]: INFO nova.compute.manager [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Attaching volume 454637d1-a1d8-4e73-9a37-41f76a12907a to /dev/vdb
Apr 13 22:18:33 user nova-compute[71325]: DEBUG os_brick.utils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2208e807-fed5-43a7-9b5f-982765964933]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f717cc04262\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2320c4b7-de77-4834-8c3b-d5784588ba84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5814b6-2e07-4ce8-9910-515fd9d66f58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b82711f-613e-4cbf-ab5b-95b4c9c45948]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Running cmd (subprocess): nvme version {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 'nvme version' failed. Not Retrying. {{(pid=71325) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] nvme not present on system {{(pid=71325) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:18:33 user nova-compute[71325]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d5182f-c8f9-4676-ba29-5256c06fd8a6]: (4, '') {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71325) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.lightos [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] LIGHTOS: no hostnqn found. {{(pid=71325) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG os_brick.utils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f717cc04262', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG nova.virt.block_device [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Updating existing volume attachment record: c19a77bc-2391-4a56-b327-3b748a08df92 {{(pid=71325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:18:33 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:18:35 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:37 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:18:37 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:18:37 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Calling os-brick to attach iSCSI Volume {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VoNmaPQn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:18:38 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:18:38 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:18:38 user nova-compute[71325]: INFO os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9979a9fb-05da-4f9e-9e6f-a3a8f7000f27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:18:38 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --interface default --op new {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbb8a4a-7a51-44f6-80d7-8a21c57a23f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a] added\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a] added
Apr 13 22:18:38 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.126s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bbf9d3-ae76-4a7f-8a04-b0be1fe8c116]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[47954f8c-c329-4755-a870-48cbaa36dfc0]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VoNmaPQn {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VoNmaPQn" returned: 0 in 0.023s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c59cdd-3787-4fdb-bd60-2ac86b4b1e92]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VoNmaPQn'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[578a1075-201c-45b4-977c-1a930cf68bfd]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abb4f6f-c115-4dec-b505-a0c5ce8d0256]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 22:18:38 user nova-compute[71325]:  {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 22:18:38 user nova-compute[71325]:  {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:18:38 user nova-compute[71325]: WARNING os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 22:18:38 user nova-compute[71325]: 
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --login {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9b9bfd-19d4-4643-88d8-5486f84cfdb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a, portal: 172.16.0.220,3260]
Apr 13 22:18:38 user nova-compute[71325]: Login to [iface: default, target: iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a, portal: 172.16.0.220,3260] successful.
Apr 13 22:18:38 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[41116ead-c290-4043-9af5-1c63aa6280b3]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb7ccd6-965f-47c2-9262-d8c1462bd878]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a (non-flash)
Apr 13 22:18:38 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a (non-flash)
Apr 13 22:18:38 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Connected to 172.16.0.220:3260 {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=71325) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71325) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c155a18c-7529-4acb-b73b-532e37caa056]: (4, ('- - 0', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71325) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VoNmaPQn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71325) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:18:38 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:18:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:18:39 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23165373839306331', 'path': '/dev/sdb'} {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:18:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165373839306331', 'path': '/dev/sdb'} {{(pid=71325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:18:39 user nova-compute[71325]: DEBUG nova.objects.instance [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lazy-loading 'flavor' on Instance uuid 491ef203-bf06-4392-9270-30a02bcd6c9f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:18:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:18:39 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:18:39 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:18:39 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:18:39 user nova-compute[71325]:   <serial>454637d1-a1d8-4e73-9a37-41f76a12907a</serial>
Apr 13 22:18:39 user nova-compute[71325]: </disk>
Apr 13 22:18:39 user nova-compute[71325]:  {{(pid=71325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:18:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] No BDM found with device name vda, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:18:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:18:39 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] No VIF found with MAC fa:16:3e:97:6f:a2, not building metadata {{(pid=71325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:18:39 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:18:39 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:18:39 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.537s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:40 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:45 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681424310.6919096, 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:18:45 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] VM Stopped (Lifecycle Event)
Apr 13 22:18:45 user nova-compute[71325]: DEBUG nova.compute.manager [None req-82dc3adf-b789-4190-a5b2-b690aa2726d0 None None] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:18:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:18:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:18:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:18:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:18:45 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:18:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:18:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:18:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:18:50 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "491ef203-bf06-4392-9270-30a02bcd6c9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:51 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:51 user nova-compute[71325]: INFO nova.compute.manager [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Detaching volume 454637d1-a1d8-4e73-9a37-41f76a12907a
Apr 13 22:18:52 user nova-compute[71325]: INFO nova.virt.block_device [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Attempting to driver detach volume 454637d1-a1d8-4e73-9a37-41f76a12907a from mountpoint /dev/vdb
Apr 13 22:18:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Attempting to detach device vdb from instance 491ef203-bf06-4392-9270-30a02bcd6c9f from the persistent domain config. {{(pid=71325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:18:52 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:18:52 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:18:52 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:18:52 user nova-compute[71325]:   <serial>454637d1-a1d8-4e73-9a37-41f76a12907a</serial>
Apr 13 22:18:52 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:18:52 user nova-compute[71325]: </disk>
Apr 13 22:18:52 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:18:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Successfully detached device vdb from instance 491ef203-bf06-4392-9270-30a02bcd6c9f from the persistent domain config.
Apr 13 22:18:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 491ef203-bf06-4392-9270-30a02bcd6c9f from the live domain config. {{(pid=71325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.guest [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:18:52 user nova-compute[71325]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:18:52 user nova-compute[71325]:   <source dev="/dev/sdb"/>
Apr 13 22:18:52 user nova-compute[71325]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:18:52 user nova-compute[71325]:   <serial>454637d1-a1d8-4e73-9a37-41f76a12907a</serial>
Apr 13 22:18:52 user nova-compute[71325]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:18:52 user nova-compute[71325]: </disk>
Apr 13 22:18:52 user nova-compute[71325]:  {{(pid=71325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "491ef203-bf06-4392-9270-30a02bcd6c9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-407220e4-cb14-404b-9e23-150615938b70 None None] Received event <DeviceRemovedEvent: 1681424332.483189, 491ef203-bf06-4392-9270-30a02bcd6c9f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.driver [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 491ef203-bf06-4392-9270-30a02bcd6c9f {{(pid=71325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:18:52 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Successfully detached device vdb from instance 491ef203-bf06-4392-9270-30a02bcd6c9f from the live domain config.
Apr 13 22:18:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VoNmaPQn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:18:52 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f58ed75-614a-498d-b6b1-a69fbcd4860d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:18:52 user nova-compute[71325]: No targets found.
Apr 13 22:18:52 user nova-compute[71325]: iSNS:
Apr 13 22:18:52 user nova-compute[71325]: No targets found.
Apr 13 22:18:52 user nova-compute[71325]: STATIC:
Apr 13 22:18:52 user nova-compute[71325]: Target: iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a
Apr 13 22:18:52 user nova-compute[71325]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:18:52 user nova-compute[71325]:                 Iface Name: default
Apr 13 22:18:52 user nova-compute[71325]: FIRMWARE:
Apr 13 22:18:52 user nova-compute[71325]: No targets found.
Apr 13 22:18:52 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:18:52 user nova-compute[71325]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:18:52 user nova-compute[71325]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71325) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a', 0)] {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ee632e-079b-49bd-aa14-0803f276d481]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ddecd7-765a-4885-9d0a-9b1258a48ea1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a (non-flash)\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a (non-flash)
Apr 13 22:18:52 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a (non-flash)
Apr 13 22:18:52 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5c4437eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a'): ({'sdb'}, set())}) {{(pid=71325) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Removing single pathed devices sdb {{(pid=71325) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6254f9-8b43-4c76-b24e-e9dc03ed1a2d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a464cc-039e-4759-a1ed-b846af7bba7f]: (4, ('ok\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Flushing IO for device /dev/sdb {{(pid=71325) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e60ab1-0f2a-4c58-bf59-fa397fbd131b]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71325) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d74f2a-ebc7-49a8-8099-e1849b30406a]: (4, ('1', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.linuxscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] SCSI volumes sdb have been removed. {{(pid=71325) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a')] {{(pid=71325) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c689c8a-f2b3-43b4-b50f-7d810638e269]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --logout {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[be72baeb-3bfc-4253-87e0-0feef54f77e4]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a, portal: 172.16.0.220,3260]
Apr 13 22:18:52 user nova-compute[71325]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a, portal: 172.16.0.220,3260] successful.
Apr 13 22:18:52 user nova-compute[71325]:  stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --op delete {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33a701c-fd10-4274-a942-e917a79d0e9e]: (4, ('', '')) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71325) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] <== disconnect_volume: return (264ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:18:52 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:18:53 user nova-compute[71325]: DEBUG nova.objects.instance [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lazy-loading 'flavor' on Instance uuid 491ef203-bf06-4392-9270-30a02bcd6c9f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:18:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.608s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.474s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:53 user nova-compute[71325]: INFO nova.compute.manager [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Terminating instance
Apr 13 22:18:53 user nova-compute[71325]: DEBUG nova.compute.manager [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Start destroying the instance on the hypervisor. {{(pid=71325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:18:53 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-be294b26-71f6-4153-b794-896159df1aa4 req-12c8a0e8-500d-40cb-9b17-e4fabbfda89c service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Received event network-vif-unplugged-50746410-9ced-436f-9be1-83b8b4c1d60a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:18:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-be294b26-71f6-4153-b794-896159df1aa4 req-12c8a0e8-500d-40cb-9b17-e4fabbfda89c service nova] Acquiring lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-be294b26-71f6-4153-b794-896159df1aa4 req-12c8a0e8-500d-40cb-9b17-e4fabbfda89c service nova] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:53 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-be294b26-71f6-4153-b794-896159df1aa4 req-12c8a0e8-500d-40cb-9b17-e4fabbfda89c service nova] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-be294b26-71f6-4153-b794-896159df1aa4 req-12c8a0e8-500d-40cb-9b17-e4fabbfda89c service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] No waiting events found dispatching network-vif-unplugged-50746410-9ced-436f-9be1-83b8b4c1d60a {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:18:53 user nova-compute[71325]: DEBUG nova.compute.manager [req-be294b26-71f6-4153-b794-896159df1aa4 req-12c8a0e8-500d-40cb-9b17-e4fabbfda89c service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Received event network-vif-unplugged-50746410-9ced-436f-9be1-83b8b4c1d60a for instance with task_state deleting. {{(pid=71325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:18:54 user nova-compute[71325]: INFO nova.virt.libvirt.driver [-] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Instance destroyed successfully.
Apr 13 22:18:54 user nova-compute[71325]: DEBUG nova.objects.instance [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lazy-loading 'resources' on Instance uuid 491ef203-bf06-4392-9270-30a02bcd6c9f {{(pid=71325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.vif [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2009437104',display_name='tempest-VolumesSnapshotTestJSON-instance-2009437104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2009437104',id=47,image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:16:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce27f9e91bca45b897b419eac137138c',ramdisk_id='',reservation_id='r-pav5kt61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f414347d-1c32-419c-89fc-b23b61a6c286',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-793841889',owner_user_name='tempest-VolumesSnapshotTestJSON-793841889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:16:49Z,user_data=None,user_id='cca0b25a70ee4f8e986db91bb9a54662',uuid=491ef203-bf06-4392-9270-30a02bcd6c9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50746410-9ced-436f-9be1-83b8b4c1d60a", "address": "fa:16:3e:97:6f:a2", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50746410-9c", "ovs_interfaceid": "50746410-9ced-436f-9be1-83b8b4c1d60a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Converting VIF {"id": "50746410-9ced-436f-9be1-83b8b4c1d60a", "address": "fa:16:3e:97:6f:a2", "network": {"id": "1a54a91f-df14-4f72-a7da-7925d7095861", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1436212472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce27f9e91bca45b897b419eac137138c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50746410-9c", "ovs_interfaceid": "50746410-9ced-436f-9be1-83b8b4c1d60a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG nova.network.os_vif_util [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:6f:a2,bridge_name='br-int',has_traffic_filtering=True,id=50746410-9ced-436f-9be1-83b8b4c1d60a,network=Network(1a54a91f-df14-4f72-a7da-7925d7095861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50746410-9c') {{(pid=71325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG os_vif [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:6f:a2,bridge_name='br-int',has_traffic_filtering=True,id=50746410-9ced-436f-9be1-83b8b4c1d60a,network=Network(1a54a91f-df14-4f72-a7da-7925d7095861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50746410-9c') {{(pid=71325) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50746410-9c, bridge=br-int, if_exists=True) {{(pid=71325) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:18:54 user nova-compute[71325]: INFO os_vif [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:6f:a2,bridge_name='br-int',has_traffic_filtering=True,id=50746410-9ced-436f-9be1-83b8b4c1d60a,network=Network(1a54a91f-df14-4f72-a7da-7925d7095861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50746410-9c')
Apr 13 22:18:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] calling os-brick to detach iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc5c461f6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:454637d1-a1d8-4e73-9a37-41f76a12907a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VoNmaPQn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:18:54 user nova-compute[71325]: WARNING os_brick.initiator.connectors.base [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:18:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.021s {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=82476) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[a728e3f7-0dd1-4185-9c4d-19abe04c5af0]: Unexpected error while running command.
Apr 13 22:18:54 user nova-compute[71325]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 22:18:54 user nova-compute[71325]: Exit code: 21
Apr 13 22:18:54 user nova-compute[71325]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 22:18:54 user nova-compute[71325]: Stderr: '' {{(pid=82476) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 13 22:18:54 user nova-compute[71325]: Traceback (most recent call last):
Apr 13 22:18:54 user nova-compute[71325]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 13 22:18:54 user nova-compute[71325]:     ret = func(*f_args, **f_kwargs)
Apr 13 22:18:54 user nova-compute[71325]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 13 22:18:54 user nova-compute[71325]:     return func(*args, **kwargs)
Apr 13 22:18:54 user nova-compute[71325]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 13 22:18:54 user nova-compute[71325]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 13 22:18:54 user nova-compute[71325]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 13 22:18:54 user nova-compute[71325]:     return putils.execute(on_execute=on_execute,
Apr 13 22:18:54 user nova-compute[71325]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 13 22:18:54 user nova-compute[71325]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 13 22:18:54 user nova-compute[71325]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 22:18:54 user nova-compute[71325]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 22:18:54 user nova-compute[71325]: Exit code: 21
Apr 13 22:18:54 user nova-compute[71325]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 22:18:54 user nova-compute[71325]: Stderr: ''
Apr 13 22:18:54 user nova-compute[71325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a728e3f7-0dd1-4185-9c4d-19abe04c5af0]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=82476) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 22:18:54 user nova-compute[71325]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 22:18:54 user nova-compute[71325]: Exit code: 21
Apr 13 22:18:54 user nova-compute[71325]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 22:18:54 user nova-compute[71325]: Stderr: ''
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 13 22:18:54 user nova-compute[71325]: ERROR os_brick.initiator.connectors.iscsi 
Apr 13 22:18:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71325) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.base [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.032s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] <== disconnect_volume: return (33ms) None {{(pid=71325) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Disconnected iSCSI Volume {{(pid=71325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:18:54 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Deleting instance files /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f_del
Apr 13 22:18:54 user nova-compute[71325]: INFO nova.virt.libvirt.driver [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Deletion of /opt/stack/data/nova/instances/491ef203-bf06-4392-9270-30a02bcd6c9f_del complete
Apr 13 22:18:54 user nova-compute[71325]: INFO nova.compute.manager [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 22:18:54 user nova-compute[71325]: DEBUG oslo.service.loopingcall [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71325) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG nova.compute.manager [-] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Deallocating network for instance {{(pid=71325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] deallocate_for_instance() {{(pid=71325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:18:54 user nova-compute[71325]: DEBUG nova.network.neutron [-] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Updating instance_info_cache with network_info: [] {{(pid=71325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:18:55 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Took 0.53 seconds to deallocate network for instance.
Apr 13 22:18:55 user nova-compute[71325]: WARNING nova.volume.cinder [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Attachment c19a77bc-2391-4a56-b327-3b748a08df92 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c19a77bc-2391-4a56-b327-3b748a08df92. (HTTP 404) (Request-ID: req-82c6a51d-c4ba-4e93-9192-90543e3d0391)
Apr 13 22:18:55 user nova-compute[71325]: INFO nova.compute.manager [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Took 0.02 seconds to detach 1 volumes for instance.
Apr 13 22:18:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:55 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:18:55 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:18:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:55 user nova-compute[71325]: INFO nova.scheduler.client.report [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Deleted allocations for instance 491ef203-bf06-4392-9270-30a02bcd6c9f
Apr 13 22:18:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.788s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-dcd1269c-007f-4130-9924-6518ac40b323 req-d9954bb0-5008-4c95-8dfc-2e08c53e6fb7 service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Received event network-vif-plugged-50746410-9ced-436f-9be1-83b8b4c1d60a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:18:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dcd1269c-007f-4130-9924-6518ac40b323 req-d9954bb0-5008-4c95-8dfc-2e08c53e6fb7 service nova] Acquiring lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:18:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dcd1269c-007f-4130-9924-6518ac40b323 req-d9954bb0-5008-4c95-8dfc-2e08c53e6fb7 service nova] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:18:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [req-dcd1269c-007f-4130-9924-6518ac40b323 req-d9954bb0-5008-4c95-8dfc-2e08c53e6fb7 service nova] Lock "491ef203-bf06-4392-9270-30a02bcd6c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:18:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-dcd1269c-007f-4130-9924-6518ac40b323 req-d9954bb0-5008-4c95-8dfc-2e08c53e6fb7 service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] No waiting events found dispatching network-vif-plugged-50746410-9ced-436f-9be1-83b8b4c1d60a {{(pid=71325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:18:55 user nova-compute[71325]: WARNING nova.compute.manager [req-dcd1269c-007f-4130-9924-6518ac40b323 req-d9954bb0-5008-4c95-8dfc-2e08c53e6fb7 service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Received unexpected event network-vif-plugged-50746410-9ced-436f-9be1-83b8b4c1d60a for instance with vm_state deleted and task_state None.
Apr 13 22:18:55 user nova-compute[71325]: DEBUG nova.compute.manager [req-dcd1269c-007f-4130-9924-6518ac40b323 req-d9954bb0-5008-4c95-8dfc-2e08c53e6fb7 service nova] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Received event network-vif-deleted-50746410-9ced-436f-9be1-83b8b4c1d60a {{(pid=71325) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:18:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:19:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:19:09 user nova-compute[71325]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681424334.3118327, 491ef203-bf06-4392-9270-30a02bcd6c9f => Stopped> {{(pid=71325) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:19:09 user nova-compute[71325]: INFO nova.compute.manager [-] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] VM Stopped (Lifecycle Event)
Apr 13 22:19:09 user nova-compute[71325]: DEBUG nova.compute.manager [None req-6f3a5869-6719-4012-9843-a6e50e5d3e48 None None] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Checking state {{(pid=71325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:19:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:19:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:19:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71325) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:19:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:19:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71325) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:19:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:19:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:19:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:19:20 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:19:22 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:19:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:19:25 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:19:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:19:29 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:19:31 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:19:31 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:19:31 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:19:31 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Didn't find any instances for network info cache update. {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 22:19:31 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:19:31 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:19:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:19:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:19:31 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:19:31 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:19:32 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:19:32 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:19:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=26.144725799560547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:19:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:19:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:19:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:19:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:19:32 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:19:32 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:19:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:19:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:19:33 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:19:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:19:35 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:19:37 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:19:38 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:19:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:19:39 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:19:40 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:19:40 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:19:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:19:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:19:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:19:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:20:04 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:20:09 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:20:13 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:20:14 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:20:19 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:20:24 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:20:29 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:20:29 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:20:32 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:20:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Starting heal instance info cache {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:20:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Rebuilding the list of instances to heal {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:20:32 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Didn't find any instances for network info cache update. {{(pid=71325) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 22:20:32 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:20:32 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:20:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:20:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:20:32 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:20:32 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Auditing locally available compute resources for user (node: user) {{(pid=71325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:20:33 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:20:33 user nova-compute[71325]: WARNING nova.virt.libvirt.driver [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:20:33 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Hypervisor/Node resource view: name=user free_ram=8924MB free_disk=26.14228057861328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:20:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:20:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:20:33 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:20:33 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:20:33 user nova-compute[71325]: DEBUG nova.compute.provider_tree [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed in ProviderTree for provider: 2eb44a42-41ff-4980-ae1c-f21099638e55 {{(pid=71325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:20:33 user nova-compute[71325]: DEBUG nova.scheduler.client.report [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Inventory has not changed for provider 2eb44a42-41ff-4980-ae1c-f21099638e55 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:20:33 user nova-compute[71325]: DEBUG nova.compute.resource_tracker [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Compute_service record updated for user:user {{(pid=71325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:20:33 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:20:34 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:20:35 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:20:38 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:20:38 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:20:39 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:20:39 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:20:40 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:20:40 user nova-compute[71325]: DEBUG nova.compute.manager [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:20:44 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:20:49 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:20:54 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:20:55 user nova-compute[71325]: DEBUG oslo_service.periodic_task [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71325) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:20:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:20:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:20:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:20:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:20:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:20:55 user nova-compute[71325]: DEBUG oslo_concurrency.lockutils [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71325) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:20:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Verify base images {{(pid=71325) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 13 22:20:55 user nova-compute[71325]: WARNING nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0
Apr 13 22:20:55 user nova-compute[71325]: WARNING nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816
Apr 13 22:20:55 user nova-compute[71325]: WARNING nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2
Apr 13 22:20:55 user nova-compute[71325]: WARNING nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0
Apr 13 22:20:55 user nova-compute[71325]: WARNING nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586
Apr 13 22:20:55 user nova-compute[71325]: WARNING nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368
Apr 13 22:20:55 user nova-compute[71325]: WARNING nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa
Apr 13 22:20:55 user nova-compute[71325]: WARNING nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9
Apr 13 22:20:55 user nova-compute[71325]: WARNING nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f
Apr 13 22:20:55 user nova-compute[71325]: WARNING nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0
Apr 13 22:20:55 user nova-compute[71325]: INFO nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Removable base files: /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0 /opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816 /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2 /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0 /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586 /opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368 /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9 /opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0
Apr 13 22:20:55 user nova-compute[71325]: INFO nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/526107132027802e37365c9d43ef160ef48b16a0
Apr 13 22:20:55 user nova-compute[71325]: INFO nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5d3b13bb467c442361a397f43643c914b2431816
Apr 13 22:20:55 user nova-compute[71325]: INFO nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0bf36e5090d0b5b4c84f9c845fa8729002aa83b2
Apr 13 22:20:55 user nova-compute[71325]: INFO nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/600225933bad926e19e4dc33f9f1a6e9083a86a0
Apr 13 22:20:55 user nova-compute[71325]: INFO nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/831d13e04670a700e34bb7ca13422d6bb43eb586
Apr 13 22:20:55 user nova-compute[71325]: INFO nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/526d9c2885237b3dfc30470a92409f5b7f85e368
Apr 13 22:20:55 user nova-compute[71325]: INFO nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/53b20199cadec147fb841d690b3a18f0baf528aa
Apr 13 22:20:55 user nova-compute[71325]: INFO nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8e8964c84540edbbc7f027991398f2f2dc4101d9
Apr 13 22:20:55 user nova-compute[71325]: INFO nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d44cb95d946196042d39ea4c585e9c43909efb3f
Apr 13 22:20:55 user nova-compute[71325]: INFO nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/502ccd16d3bfb133912734663f744e9ed0d9bcf0
Apr 13 22:20:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Verification complete {{(pid=71325) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 13 22:20:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Verify swap images {{(pid=71325) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 13 22:20:55 user nova-compute[71325]: DEBUG nova.virt.libvirt.imagecache [None req-3564a051-3afa-41f1-bada-d17d9441dba5 None None] Verify ephemeral images {{(pid=71325) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 13 22:20:59 user nova-compute[71325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71325) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}